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An Experimental 224 Mb/ s Digital 
Repeatered Line 


By I. DORROS, J. M. SIPRESS, and F. D. WALDHAUER 
(Manuscript received May 12, 1966) 


An experimental digital repeatered line has been developed which trans- 
mits information at a rate of 224 Mb/s as part of an experimental high- 
speed digital transmission system. The PCM terminals and time division 
multiplex portions were described by J. S. Mayo and others in the No- 
vember 1965 issue of the Bell System Technical Journal. The repeatered 
line is described in this paper. The performance of this line is shown to be 
suitable for coast-to-coast operation. 

The line utilizes 0.270-inch copper coaxial transmission lines and re- 
generative repeaters at one-mile intervals. Ten repeaters have been operated 
in tandem to form ten miles of repeatered line. Each repeater uses 25 tran- 
sistors, most of them a new germanium design with a cutoff frequency, fi, 
of 4 GHz. Esaki diodes provide the decision thresholds for the regeneration. 
Power to the repeaters is supplied by de over the center coaxial conductor. 
The pulse transmission code is paired selected ternary (PST). 


I. INTRODUCTION 


Digital transmission of information is becoming increasingly attrac- 
tive in the telephone plant because it competes favorably both in per- 
formance and in cost for telephone service and it allows all kinds of 
other services such as data and television to share the transmission 
media with virtually no interaction among the various signals. The 
digital transmission process! is based on (7) pulse code modulation of the 
analog signals to be transmitted, (27) time interleaving of the resultant 
pulse streams to form a composite pulse stream, and (777) regeneration 
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in the repeatered line to nullify the effects of noise and distortion en- 
countered in transmission. 

The T1 carrier system,?* extremely successful since its introduction 
in the Bell System in 1962, provided the first wide use of the digital 
transmission concept. In T1, 24 exchange area voice signals are pulse 
code modulated, time division multiplexed, and transmitted over cable 
pairs at a rate of 1.544 megabauds. T1 repeatered lines are now also 
in use for short-haul data services,‘ since these lines are virtually insensi- 
tive to the source of the pulse streams transmitted. 

There has also been interest in making use of the features of digital 
transmission for long-haul transmission. Recently, at Bell Telephone 
Laboratories, a 224 megabits/second (Mb/s) experimental system was 
constructed to demonstrate the feasibility of a coast-to-coast system. 
The PCM terminals and time division multiplex portions of this system 
were described by J. 8. Mayo and others in the November 1965 Bell 
System Technical Journal.®:*.7 It was there indicated that the 224 
Mb/s information rate would serve either four coded 600 channel mas- 
tergroups for a total of 2400 voice channels, 144 T1 signals representing 
24 channels each for a total of 3456 voice channels, two coded network 
TV signals, or some combination of these and other digital signals. In 
this paper, we describe the experimental repeatered line. The significant 
accomplishment is the realization of repeater circuits with suitable oper- 
ating margins that detect and regenerate pulses at a 224 megabaud rate 
(a baud interval of 4.5 nanoseconds) when each pulse is dispersed by the 
transmission medium into more than 30 baud intervals and also atten- 
uated to a level limited by thermal noise considerations. 

In Section II we give a general description of the line and a summary 
of performance. In Section III we describe the design of the overall line 
leading to the requirements on each of the repeaters. The design con- 
siderations include the pulse transmission code, the equalization for the 
loss-frequency characteristic of the coaxial transmission medium and 
the control of the accumulation of jitter in a chain of repeaters. In Sec- 
tion IV, the design of the repeater is described with emphasis on critical 
circuits such as the Esaki diode regenerator. Section V reports on per- 
formance under laboratory conditions. 


Il. GENERAL DESCRIPTION 


2.1 Brief Description of the Experimental Repeatered Line 


The configuration of the experimental repeatered line is shown in 
Fig. 1. The overall performance of such a line is characterized by the 
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rate of errors introduced into the transmitted stream of information and 
by the amount of pulse jitter introduced into this stream. 

The line operates at error rates below 107° through ten repeatered 
links. A coast-to-coast system of about 4000 repeatered links requires 
an overall error rate below 10~°, or below 2.5 X 107!° per link. Hence, 
4000 mile error performance has been achieved under laboratory con- 
ditions. 

The pulse jitter measured through ten repeatered links under labora- 
tory conditions was 138 degrees rms. From the model for the accumula- 
tion of jitter in a chain of repeaters,’ this 18 degrees implies that the 
significant component of jitter introduced per repeater is about 3 degrees 
rms. As will be discussed in Section 3.3.2, 3 degrees is an entirely ac- 
ceptable performance level in a coast-to-coast system. 

An arbitrary stream of binary unipolar pulses from the multiplex at a 
rate of 223.880 Mb/s is introduced into the line at a binary-to-PST 
translator as shown in Fig. 1. This translator converts the 2-level 
pulses into a selected ternary code, called paired selected ternary (PST), 
for transmission. The details of this code are described in Section 3.1 and 
also in an earlier paper.® Briefly, the ternary transmission of the binary 
information provides sufficient redundancy (2) to allow the transmission 
of unrestricted binary sequences while still providing timing information 
to the repeaters, (77) to eliminate de components from the transmitted 
spectrum, thus permitting ac coupling in the repeaters and powering at 
de, and (277) to allow in-service error monitoring for maintenance pur- 
poses. 

The ternary signal from the translator has its positive and negative 
pulses represented as positive pulses on separate leads. These are applied 
to the transmitting repeater which adjusts levels, combines the two 
streams, and adds de power to the signal for serial powering of the re- 
peaters. 
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Fig. 1— Experimental repeatered line. 
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This system utilizes essentially one mile of an experimental cable 
with eighteen 0.270-inch coaxials, designed at Bell Laboratorics and 
fabricated at the Western Electric Company’s Baltimore Works. The 
cable design will be reported on separately. Hach repeatered link uses 
one of the 18 coaxials in the cable. Electrically, the coaxial line inserts 
a loss that is proportional in dB to the square root of frequency (+/f) 
over the frequency range of interest. At a nominal temperature, the loss 
of a mile of 0.270-inch coaxial line is 57 dB at 112 MHz, one-half the 
baud rate. The propagation characteristics of the experimental cable 
are essentially equivalent to those of standard Bell System coaxial 
cables used for L-carrier transmission.'!® Hence, the spacing of the 
repeaters on the 0.375-inch standard coaxials now generally being in- 
stalled would be that of the experimental system modified by the ratio 
of the diameters [(1.0 miles) X (0.375/0.270) = 1.4 miles]. 

The regenerative repeater, of the forward acting complete retiming 
variety,!! performs the three R’s — reshaping, retiming, and regenera- 
tion. To reshape, an equalizer compensates for the +/f propagation 
characteristic of the transmission medium in such a manner as to 
compromise among the intersymbol interference, the noise entering at 
the repeater preamplifier, and other important degrading effects. The 
repeater spacing is controlled by this compromise. To retime, a sine wave 
with average frequency equal to the baud rate is extracted from the 
pulse train by nonlinear means. This sine wave in turn generates regu- 
larly spaced pulses of short duration for sampling the equalized wave- 
form. To regenerate, a 3-level decision is made at each sampling instant 
to determine whether a +, 0, or — pulse is to be emitted in each baud 
interval. A detailed description of the repeater is given in Section IV. 

In the experimental system, 10 such repeatered links have been oper- 
ated in tandem, looping through 10 coaxials of the 18-coaxial cable to 
form 10 miles of line. 

In the receiving repeater, the de powering circuit is completed, the 
levels are adjusted, and the positive and negative pulses are separated 
into two unipolar streams for application to the PST-to-binary trans- 
lator. Finally, a PST violation monitor makes use of a redundant prop- 
erty of the PST code to monitor errors as described in Section 3.1.4.9 


2.2 Main Stations 


An actual long-haul repeatered line would have main stations spaced 
at appropriate intervals to house equipment for (2) powering the line 
repeaters through the transmitting and receiving repeaters, (it) isolating 
and automatically switching out a section of line for maintenance pur- 
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poses, (227) controlling the accumulation of pulse jitter in a long. re- 
peatered line,®”’ and (v) dropping and adding information-bearing 
pulse streams (multiplexing). 

The main station spacing appears to be determined primarily by the 
multiplexing considerations. The limitation due to powering is based on 
the power required by the repeaters and the maximum practical voltage 
which can be applied to the coaxials and the repeaters. The limitation 
duc to section isolation considerations depends on the combined relia- 
bility of the cable and the repeaters. We will not deal with the power 
and section isolation questions in this paper, but we will show in Section 
3.3 that jitter control is required only at very distant spacings, and 
hence is not a consideration in the spacing of main stations. 


III. DESIGN OF THE LINE 


The overall design of the experimental 224 Mb/s digital repeatered 
line is described in this section; the repeater itself is described in Section 
IV. We discuss the pulse transmission code in Section 8.1, the equaliza- 
tion of a link of repeatered line in Section 3.2, and the retiming of such 
a link in Section 3.8. The derivation of performance objectives for a 
single repeater from the overall objectives for a 4000-mile system is 
included; we treat error rate in Section 3.2 and jitter in Section 3.3. 


3.1 Pulse Transmission Code 


3.1.1 Purposes of a Transmission Code 


The binary information from the multiplex must be coded into a se- 
quence of signal symbols that is readily transmitted over a practical 
line. The transmission code adds redundancy to the binary information 
to permit the three specific functions described below. 

Conceptually, the simplest pulse transmission code is unipolar in which 
the binary marks and spaces are coded for transmission as presence and 
absence of pulses. There are three significant practical problems asso- 
ciated with this unipolar format: 

(z) Timing information must be extracted from the pulse train at each 
repeater to determine when the pulse, no-pulse decisions should be 
made and to retime the regenerated pulses emitted by cach repeater. 
Long sequences of binary spaces result in long periods without pulses 
and henee, without timing information. This in turn yields poor timing 
performance, leading to increased error rate and pulse position jitter. 

(72) Since the repeaters are serially powered by means of de trans- 
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mitted on the center conductors of the coaxials, the signal path in the 
repeaters cannot be de coupled to the cable medium. Consequently, 
the transmission of varying densities of marks results in de wander of 
the pulse stream, thereby reducing drastically the margins in the de- 

tection process. DC restoration circuits which could eliminate this 
wander appeared unfeasible for the experimental repeater because of the 
high baud rate. 

(i7i) Some method of determining error performance without the 
interruption of service is essential for maintenance purposes. In-service 
monitoring of the line error rate with the unipolar format as described 
above is impossible because each unipolar binary symbol carries exactly 
1 bit of information with no redundancy. 

All three of these problems can be eliminated by introducing redun- 
daney into the coding process. In the experimental line, the required 
redundancy is obtained by employing 3-level transmission (+,0,—) at 
a line baud rate equal to that of the binary information rate. This redun- 
dancy is log.3 — 1 = 0.59 bits/symbol. 

Another means of achieving the necessary redundancy is to utilize 
polar binary transmission at a line baud rate higher than the information 
rate. This appears to be an unattractive alternative for a coaxial me- 
dium because the higher baud rate, resulting from a compromise satisfy- 
ing the above three constraints with reasonable coding complexity, 
more than offsets the potential signal-to-noise advantage of detecting 
2-level signals rather than 3-level signals. 


3.1.2 The Paired Selected Ternary (PST) Code 


The pulse transmission code is paired selected ternary (PST).° In this 
code, the binary sequence to be transmitted is framed into pairs and 
translated into a ternary format according to Table I. There are two 
modes in the PST code and the mode is changed after each occurrence 
of either a 10 or a 01 binary pair. As an example of PST coding, consider 
the following binary sequence and the corresponding PST sequence. 


BINARY 10 01 00 01 11 01 
PST +0 0-— —+ 04+ +-— 0- 


Note the change of mode after each occurrence of a 10 or a O01 pair in 
the binary sequence. 

Six of the nine possible ternary symbol pairs are used to represent 
the four possible binary symbol pairs. The remaining three unused 
ternary symbol pairs are used for framing the pairs at the receiver. 
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TABLE I[— THE PAIRED SELECTED TERNARY CODE 
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Change mode after each 10 or 01 


The alternation of modes produces a null in the power spectrum at de 
when the positive and negative pulses are balanced (identical except for 
sign). This enables de powering of the repeaters. The PST power spec- 
trum, W(f), normalized to the baud interval, 7’, is presented in Fig. 2 for 
the case of equally likely marks and spaces in the original binary se- 
quence [p(1) = p(0)], cosine-squared pulses one baud interval in dura- 
tion at the base, and balanced positive and negative pulses. For other 
than this idealized situation, see Ref. 9. 

The coding of the 00 binary pair into the —+ PST pair eliminates the 
timing problems associated with the transmission of long sequences of 
0’s. An additional feature of the PST code is that timing information 
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Fig. 2— PST power spectrum for a random binary sequence. 
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Fig. 3— Logical diagram of the binary-to-PST translator. 
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at the repeaters can be extracted by nonlinear means (rectification). 
This avoids the harmonic and phase distortion problems associated 
with other schemes involving the linear extraction of timing information 
from the low-level components received at the baud frequency. 

A logical diagram of the binary-to-PST translator is shown in Fig. 3. 


3.1.3 Translation of PST Sequences Back Into Binary 


At the receiving end of the line, the original binary sequence is re- 
covered from the selected ternary sequence in the PST-to-binary trans- 
lator. 

Framing is essential to associate the symbols which are part of the 
same PST pair. The effect of incorrect framing is demonstrated below. 


Binary 10 O1 00 Ol 11 01 
PST +0 O- -+ O+ pS, (f= 
Incorrectly framed PST + O00 —— +0 ++ —O0 -—- 
Incorrect binary ? rs 10 ? 10 

The unused ++, ——, and 00 ternary pairs are detected to indicate an 


out-of-frame condition. 

The PST-to-binary translator is shown in Fig. 4. Out-of-frame indica- 
tions are applied to a flywheel circuit which prevents randomly occurring 
line errors from initiating a change in frame. The flywheel requires that 
three out-of-frame indications occur within 19 consecutive pairs (88 
baud intervals or 170 nanoseconds) to initiate a change in frame. The 
cumulative probability of obtaining three out-of-frame indications 
within J consecutive pairs after going out of frame is given by the N = 3 
curve in Fig. 5 for the case of equally likely marks and spaces in the 
original binary sequence. The mean time (in PST pairs) to occurrence of 
N out-of-frame indications is shown as JZ. 

To reduce the effect of erroneous frame shifts due to line errors, the 
flywheel is disabled for a period of 19 pairs after a change in frame. 
During this period, only one out-of-frame indication is required to ini- 
tiate a second frame shift pulse, thereby reestablishing the original fram- 
ing condition. The cumulative probability of obtaining one out-of-frame 
indication within J pairs is indicated by the N = 1 curve in Fig. 5. 
The mean time to an incorrect initiation of a change of frame due to 
randomly occurring line errors is shown in Fig. 6 as a function of error 
rate, assuming p(1) = p(0) = 4. For the required error rates of 10-6, 
such false misframes are extremely unlikely. 
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Fig. 4— Logical diagram of the PST-to-binary translator. 
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3.1.4 In-Service Error Performance Monitoring 


A method of monitoring line error performance without interrupting 
service is a necessary maintenance feature of a long-haul digital trans- 
mission system. PST sequences contain certain properties which are 
violated only when errors occur. Violations of these properties can be 
monitored to determine the error performance on an in-service basis. 

Four different properties whose violation provide means of error 
monitoring are given in Ref. 9. One of these, the bipolar property of PST, 
is employed in the experimental line. 

To error monitor with the bipolar property, we first remove all of the 
+ — and —-+ ternary pairs from the pulse stream. The remaining pulses, 
which come from coding the binary 10 and 01 pairs, alternate in polarity. 
An error causes a violation of this alternation or bipolar property, as in 
the example below. 


PST pulse stream +0 O— —+ 04+ +- 0- 
PST with +— and —+ +0 O0-— 00 0+ 00 O0- 
removed 
Error 
PST with error +0 +-—- -—-+ 04+ 4+- 0- 
Violation 
PST with errorand+— and +0 00 00 0+ 00 0O— 
—-+ removed 


The violation can occur some time after the error, but all singly occurring 
errors* are detected. 
A logical diagram of the PST violation monitor is shown in Fig. 7. 
Since this form of violation monitoring requires framing common to 
PST-to-binary translation, these two functions have been combined in 
one circuit in the experimental system. 


3.1.5 Circuit Techniques for PST Code Translation 


The laboratory realization of the PST code translation equipment has 
made extensive use of Schottky barrier diodes and emitter-coupled 
current-routing pairs using transistors having an f 7 of 3 GHz. The diodes 
perform the logic and the current routing pairs provide isolation, am- 
plification, amplitude regeneration, and, when appropriately connected, 
logical inversion. Tig. 8 shows one of the four binary pair detectors in the 


* For the low error rates we are interested in, the rate of singly occurring errors 
is essentially the total error rate. 
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Fig. 8— Binary pair detector at the input of the PST-to-binary translator — 
typical of the logic gates in the code conversion equipment. 
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binary-to-PST translator, a circuit typical of the logic gates used 
throughout the translation equipment. The input signals to the gates are 
at least one-half volt to insure complete switching of the emitter current 
from one transistor to the other. 

Another circuit used extensively in the code translation equipment is 
the Goto pair binary counter, shown in Tig. 9, which employs two Esaki 
diodes. 


QO -2v4 


He 


OUT 


O 
+8V -8V see a Es +8V 


Fig. 9 — Goto pair binary counter using two Esaki diodes. 
3.2 Mqualization of a Link of the Repeatered Line 


3.2.1 The Error Rate Objective 


The preliminary overall error rate objective for a 4000-mile digital 
repeatered line is a maximum of 10~°, based upon subjective testing and 
computation of noise power in the terminal signals due to line errors. 
Such an error rate will introduce negligible degradation into analog 
signals arising from services such as message, television, Picturephone* 
and voiceband data, and will yield high performance for signals already 
in digital form such as computer outputs.” If we assume an approximate 
repeater spacing of one mile, we obtain a maximum error rate objective 
of 2.56 X 107-' per repeatered link, or approximately 10—!°. This calcu- 
lation assumes uniform operation of all repeaters. In a field situation, 
we would expect to permit somewhat poorer performance in several re- 
peaters since the bulk of the repeaters normally would be operating at 
substantially better than this level. To place an objective on this, how- 
ever, requires more knowledge of uniformity of repeater operation than 
is presently available. 


* Service mark of the Bell System. 
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3.2.2 Model of the Signal Path 


A model of the signal path in a link of a repeatered line is shown in 
Fig. 10. The signal path begins at the regenerator output in a repeater 
and ends at the regenerator input in the next repeater. The overall 
transmission of the signal path from Sy(f) to Ry(f) is denoted T(‘). 

The loss of a coaxial tube in a cable, C(f), is primarily dependent on 
the skin effect in the conductors and therefore this loss in dB is essentially 
proportional to the square root of frequency in the range of interest to 
us, and linearly proportional to the cable length. A single pulse through 
C(f) alone is highly attenuated and severely dispersed and therefore gain 
and equalization are required to amplify and shape the pulse stream 
prior to detection in the regenerator. In the model, there are two equaliz- 
ing blocks, £i(f) and £2(f), and two amplifying blocks, Ai(f) and Ae(/f). 
The details of this separation will be discussed later, but it can briefly 
be stated here that the amplifier split is to sectionalize the required high 
gain, and the equalizer split is a compromise to limit the noise band- 
width, to prevent overload of the preamplifier, and to provide surge 
protection for the repeater output. The power separation filters at the 
input and output of the repeater are included in Ai(f) and £,(f). 

Our analyses have been carried out with cosine-squared regenerator 
output pulses one-half baud interval in duration at half-amplitude. 
This is a good approximation for the experimental system. The detailed 
shape of these pulses is not important because the spectrum of such a 
narrow pulse is nearly flat over the important frequencies in Tf), which 
only go up to about three-fourths of the baud frequency. Hence, it is 
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Fig. 10 — Signal path model. 
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only the total area of these pulses that is important. The pulse duration 
used was chosen for convenience in implementation. 

The outer conductor of the coaxial is 0.005-inch thick copper with a 
soldered seam. The conductor thickness is sufficient to essentially isolate 
the signals inside the coaxial from the outside world. Hence, the con- 
trolling disturbance to the signal is the sum of the thermal noise of 
the cable and the noise generated in the preamplifier. This is shown in the 
model as an equivalent noise source at the preamplifier input, N(f). 

The key measure of the performance of a repeater is the error rate. 
This rate, in turn, is dependent on the ability of the regenerator to decide 
correctly whether -+, 0, or — pulses were transmitted in each of the 
baud intervals. We are, therefore, highly concerned about the details 
of the waveform at the regenerator input, ry(¢). Equalization /,(f)£2(f) 
compensates for the shape of C(f) and the imperfections in the trans- 
mission characteristic of Ai(f)A2(f). Also, the bandwidth of the noise 
entering the regenerator is primarily determined by /2(f). The optimum 
equalization maximizes the repeater spacing for a given error rate ob- 
jective by means of a compromise between intersymbol interference and 
noise, while taking into account variations in coaxial loss due to temper- 
ature variations, sampling amplitude threshold offset, sampling timing 
misalignment, and other practical degradations. 

An analytical solution for the optimum equalization in the face of all 
of the practical degradations in the repeatered link is not tractable. 
The general problem of optimum equalization for pulse detection has 
been treated in the literature,®'“ but nowhere, including in analyses of 
our own, is there a solution to an applicable model. Consequently, we 
simulated the repeatered link on a digital computer in such a manner 
as to allow examination of the effects of the following: 

(7) variations in the transmission characteristics of the coaxial, 
C(f), the amplifiers, Ai(f) and A2(f), and the equalizers, Hi(f) and L2(f); 

(it) Gaussian noise with arbitrary power spectrum; 

(117) static and dynamic sampling time misalignment; 

(cv) variations in detection threshold; 
(v) variations in the statistics of the input binary sequence; 
(vt) variations in the regenerator output pulse shape. 


3.2.3 Signal-to-Noise Ratio and Error Rate 


The theoretical error rate in the detection of a signal in the presence 
of Gaussian noise follows the well-known curve shown in Jig. 11.% 
Note that we have plotted peak signal-to-rms-noise. It is the peak sig- 
nal that is of interest to us since the power limitation is in the repeater 
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Fig. 11— Theoretical error rate as a function of peak signal-to-rms-noise ratio. 


peak output capability, not in its average signal power. Also, because 
of the shielded nature of the coaxial medium, transmitted signals do not 
interfere with any other signals. 

The interpretation of Fig. 11 is that the average error rate indicated 
by the ordinate will prevail if the ratio of the peak of an isolated pulse 
to rms Gaussian noise, with no interfering signals or other degrading 
effects at the time of detection, is the quantity in dB indicated by the 
abscissa. Under practical conditions with a high baud rate there will 
be intersymbol interference and other degradations. Hence, at the de- 
cision instants the signal will depart from the ideal case, where there is 
either a full peak or no signal at all, and where the decision time instant 
and threshold are perfect. Fig. 11 must, therefore, be interpreted ap- 
propriately. 

To avoid the difficulty of dealing with statistical intersymbol inter- 
ference and other degradations, we conservatively design for the worst 
case. Hence, Fig. 11 may be used to determine the upper bound on the 
error rate if the peak signal is interpreted as the difference at the sam- 
pling instant between the minimum amplitude of all received pulse 
signals and the maximum amplitude of all received no-pulse signals. 
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The worst case is the combination of the worst intersymbol inter- 
ference resulting principally from cable temperature changes and cir- 
cuit imperfections, and the other degradations such as nonideal sampling 
where both the time instant and the threshold are imperfect. The lump- 
ing of the other degradations with intersymbol interference is illustrated 
in Fig. 12 using the ternary eye. This eye represents the inner boundaries 
of all possible pulse sequences superimposed and synchronized with the 
baud rate; in addition, the boundaries have been displaced inward verti- 
cally and horizontally to account for the other degradations. Resulting 
eye heights H, and H_ now represent the peak signal for use on I’ig. 11, 
and the time and amplitude crosshairs now are of zero width. In what 
follows, H is taken to represent cither H, or H_. 

From Fig. 11, we see that in order to maintain the per repeater 107!° 
error rate objective indicated in Section 3.2.1, under extreme conditions 
(due to pulse sequences, cable temperature, parameter drifts, and 
sampling time and threshold displacements), the ratio of H to the rms 
noise must be 22 dB. It follows then that the ratio of the peak of the 
pulse, P, to the rms noise is greater than the theoretical value of 22 dB 
by an impairment defined as 


I = 20 log (P/H). 


The impairment, J, is the excess peak-signal-to-rms-noise ratio in dB 
required to compensate for the worst case degraded eye due to the total 
of the intersymbol interference and other degradations. Due to the rapid 
increase with frequency of the loss of the coaxial, a small increase in 
equalized bandwidth for the purpose of reducing intersymbol inter- 
ference produces a large increase in noise. The compromise between 
intersymbol interference and noise, therefore, is balanced in favor of 
reduced bandwidth. Our specific compromise allows enough intersymbol 
interference and other degradations to reduce H to 0.2 P, which corre- 
sponds to an I of 14 dB. 

It should be pointed out that the eye opening, H, is an artificial one 
with idealized crosshairs and, therefore, is not what is seen on an os- 
cilloscope at the regenerator input. What is seen on an oscilloscope is 
the eye with all degradations up to the input to the practical detector. 
The detector, however, has its own degradations which are included in 
the artificial eye. 


3.2.4 Signal Path Parameters for the Experimental Line 


The digital computer simulation and actual circuit performance 
achievements have led to the signal path parameters of Table IJ for a 
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Fig. 12 — Ideal and degraded eyes. 


repeatered link. These parameters have been realized, but under labora- 
tory degraded conditions rather than worse case conditions. 

Table III gives an example of the extreme conditions simultaneously 
permitted by the design implied by Table II. 

The signal path parameters of Table II impose the requirements on 
the design of the repeater itself, to be discussed in detail in Section IV. 
For the present, we have specified, (2) the loss of the cable at the half 


TasieE I] —SiGgnau PatH PARAMETERS OF A REPEATERED LINK 





Worst case error rate 10710 
Repeater peak output power +14 dBm 
Preamplifier noise figure 6 dB 
Theoretical peak signal-to-rms-noise ratio for 107!" er- 22 dB 
ror rate 
Impairment, I, for worst case degradations 14 dB 
Ratio of peak equalized single pulse to rms noise under 36 dB 
nominal conditions 
Loss of coaxial between repeaters 57 dB at 112 MHz 


oe length of 0.270-inch coaxial at nominal (5320 ft) 
55°F 


Equalizer singularities Zeros: 11 MHz 
15 MHz 
70 MHz 


Poles: 94 MHz 
161 MHz /+117° 


196 MHz /+4-114° 
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TasLe IT] — Examp.eé or EExtTrREME CONDITIONS 
SIMULTANEOUSLY PERMITTED 





Cable temperature rise 21°F (maximum expected) 
Equivalent echo at the sampling instant 20% of the pulse peak 
Sampling amplitude threshold offset 10% of the pulse peak 
Static sampling timing misalignment* 20° 


Dynamic sampling timing misalignment distribution*| cos with 60° base width 
Noise figure 7 dB 





* 360° is one baud interval. 


baud rate which bears on the gain in the repeater,t (77) the required 
output power and noise figure of the repeater, (727) the equalizer singu- 
larities, and (iv) the allowed impairment. The repeater design will take 
up from there. 

As an indication of the significance of these signal path parameters, 
we refer to Figs. 18 through 17. First, the loss at 55°F of a coaxial be- 
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Pag 13 — Loss of 53820 feet of 0.270-inch coaxial at 55°F on the usual log f 
scale. 


tween repeaters is shown in Fig. 13 plotted on the usual log frequency 
scale in accordance with conventional characterization of transmission 
media. This curve (loss in dB) follows essentially the square root of 
frequency and goes through 57 dB at 112 MHz. 

The nominal losses of the cable, the equalization including the effect 
of the amplifiers, and the overall channel with 50 dB net effective flat 
gain, are shown in Trig, 14. 


+ The loss of the peak of a pulse through the signal path is given approximately 
by the loss of this path at a frequency corresponding to half the baud rate.* 
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Fig. 14— Cable, equalization, and overall channel loss characteristics. 
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Fig. 15 — Nominal isolated pulse without equalization. 
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Due to the great variation of the cable loss over the frequency band 
of interest, the nominal isolated pulse without benefit of equalization is 
severely dispersed as shown, normalized to its own peak, in Fig. 15. It 
has a rise time of about 3 baud intervals and a fall time of about 25 
baud intervals. The undershoot is due to the lack of de transmission in 
the power separation filters and is of little significance since there are 
balanced numbers of positive and negative pulses in the PST code. As a 
result of the dispersion, the peak amplitude of all possible unequalized 
pulse sequences varies over a 28-dB range. The problem of dealing with 
the resulting large dynamic range in the repeater is discussed further in 
Section 4.1. 

The nominal single equalized pulse is shown in Fig. 16. It is apparent 
that the amplitudes at —1.0, +1.0, +2.0, and +3.0 baud intervals are 
small. Under degraded conditions, however, these amplitudes are sub- 
stantial. The low amplitude negative tail of such an isolated pulse, 
which obviously must be present in the response of a channel without 
de transmission, is off the chart. The inner boundary of the superposition 
of this single pulse in all possible PST sequences forms the nominal eye 
shown in Jig. 17. The uppermost curve in this figure is the envelope of 
the maximum values of all pulse sequences. The slow-acting automatic 
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Fig. 16 — Nominal single equalized pulse. 


EXPERIMENTAL DIGITAL REPEATERED LINE 1015 















































AMPLITUDE NORMALIZED TO THE PEAK OF A SINGLE PULSE 




















“05-04 =-03 =02 =01 O° Of 02) 0.3. G4. OS 
TIME IN BAUD INTERVALS 


Fig. 17— Nominal positive eye at the regenerator — inner boundary of the 
superposition of all possible PST sequences using the nominal single equalized 
pulse shown in Fig. 16. 


gain control (AGC) in the repeater operates substantially on the peak of 
this curve. It should be emphasized that this nominal eye is the one seen 
on an oscilloscope and does not include the effects of the finite crosshair 
widths. 


3.38 Fetiming in the Repeatered Line 


3.3.1 Timing Extraction at Hach Repeater 


The function of the repeater timing path is to extract timing informa- 
tion from the equalized ternary pulse stream. As discussed previously, 
this timing information is used to determine when the pulse, no-pulse 
decisions should be made as well as to retime the pulses transmitted 
from the repeater. 

The repeater uses forward acting complete retiming" with nonlinear 
extraction of the timing component from the PST sequence. The equal- 
ized pulse stream is full-wave rectified and the upper portion of the 


1016 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1966 


resulting unipolar stream is amplified and applied to a simple tuned 
circuit. The output of this is amplified and limited to produce a constant 
amplitude sinusoid which, in turn, drives a timing pulse generator. 

Each repeater introduces phase variation, or timing noise, called jitter, 
into the extracted timing information. This jitter contains a systematic 
component which is a function of the transmitted pulse pattern and 
accumulates in a chain of repeaters considerably faster than the pattern 
independent, nonsystematic component. 

The amounts of jitter introduced in and transmitted through each 
repeater can be kept low by a small effective bandwidth in the timing 
path. The smaller this bandwidth, however, the larger the static sampling 
timing misalignment for a given and inevitable mistuning of the timing 
extraction circuit. 

The jitter accumulation and the objective for the jitter introduced in 
each repeater are discussed next. 


3.3.2 Control of Jitter Accumulation and the Requirements on a 
Single Repeater 


The preliminary objective for band-limited jitter at the end of a 
4000-mile line is as shown in Fig. 18. This was derived on the basis of 
coded mastergroup message service in which the top frequency is 2.788 
MHz, such as in an L600 mastergroup or a U600 mastergroup shifted 
down in frequency for more efficient sampling.* Based upon preliminary 
analysis and subjective testing, however, this objective is probably 
controlling for all digital and analog type services including data and 
network television. These two latter services, however, require further 
study.” The effect of low-frequency jitter within the objective shown is 
a signal-to-distortion ratio in the message channels in the frequency 
multiplexed mastergroup of greater than 30 dB; the effect of high- 
frequency jitter is crosstalk between channels less than theoretical 
9-digit quantizing noise. 

In order to meet this objective with an economical repeater design, 
appropriately spaced high Q jitter reducers’ are required along the line. 
A jitter reducer includes an automatic phase control (APC) loop to 
smooth the jittered timing wave, and buffer storage for the information 
pulses. The information pulses are read into the store by the jittered 
timing wave and read out by the smoothed wave. 

The jitter performance required of each repeater is a function of the 


*In Ref. 5, this objective was given for a coded U600 mastergroup in which 
the top frequency is 3.084 MHz. 
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Fig. 18 — Objective for the maximum overall band-limited jitter due to random 
pulse sequences in a 4000-mile digital repeatered line, 


overall jitter objective, the number of jitter reducers in the overall line, 
the effective Q of each of the jitter reducers, and the effective Q of the 
timing circuits in the repeaters. 

The accumulation of jitter in a chain of repeaters with uniformly 
spaced jitter reducers can be analyzed by an extension of the technique 
developed for the analysis of jitter accumulation in the T1 system.’)!” 
The analysis is based on a model in which the following assumptions are 
made: 

(t) The significant jitter at the end of a chain of repeaters arises from 
the addition of the systematic, or pulse pattern dependent, jitter intro- 
duced in each repeater. 

(ii) At the end of a long chain of repeaters, the accumulated jitter 
due to a random pattern is gaussian. 

(iit) With respect to the transmission of accumulated jitter, the 
repeaters and jitter reducers may be replaced by the low-pass equiva- 
lents of their timing paths. 

(iv) In each repeater, the effect of all sources of jitter due to random 
patterns is equivalent to the effect of a single, band-limited, white 
timing-noise source at the input to the equivalent low pass network. 

(v) The timing noise introduced in the jitter reducers is negligible. 

The model has successfully predicted experimental results for the T1 
system,’ and there is every indication that the same will be true for a 
high-speed repeatered line with jitter reducers. The model for the high- 
speed line is shown in Fig. 19. Fr(s) and F';(s) are the low-pass equiva- 
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Fig. 19 — Model of a chain of repeaters and equally spaced jitter reducers for 
the analysis of the accumulation of jitter. 


lents of the repeater and jitter reducer timing paths, and ®, is the power 
spectral density of the equivalent band-limited white timing noise 
source. 

The results of an analysis are presented in Fig. 20 for a transcontinental 
system containing 3600 repeaters each with an effective Q of 80, and 
uniformly spaced jitter reducers each with an effective Q of 10°. In this 
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Fig. 20— Objective for the systematic component of jitter (rms) contributed 
by a single repeater versus number of equally spaced jitter reducers. 


EXPERIMENTAL DIGITAL REPEATERED LINE 1019 


figure, the requirement is given for the systematic component of jitter 
(rms) contributed by a single repeater due to random pulse patterns as a 
function of the number of equally spaced jitter reducers. If no jitter 
reducers were to be used, the repeater objective would be 0.008 ns rms 
or 0.6° rms, which when properly scaled is more stringent than the 
approximately 1° measured in T1.8 Because of the higher-speed tech- 
nology here, a practical requirement should be more liberal than the 
reported T1 performance. Based on our laboratory experience, a reason- 
able objective for the contribution of a single repeater to the systematic 
jitter due to random patterns is 0.1 ns rms or 8° rms. This leads to a 
need for four jitter reducers, each with a Q of 10°, in 4000 miles, or one 
jitter reducer every 1000 miles. In an actual system, jitter reduction is 
required at all multiplex points. These occur, on the average, at inter- 
vals substantially smaller than 1000 miles, so that jitter reduction does 
not influence the main station spacing. Further, jitter reducers with 
Q’s of Jess than 10° would be used. 


IV. DESIGN OF THE REPEATER 


A block diagram of the repeater is shown in Fig. 21. As briefly de- 
scribed in Section 2.1, the regenerative repeater performs the functions 
known as the three R’s—reshaping, retiming, and regeneration. The 





PRE- AMPLIFIER 
AMPLIFIER WITH AGC 
| 
| 
POWER | POWER 
AL- - 

e sepa- |_| -y Eee v Recen-| | ERs SEPA- 
RATION rr |_| ERATOR RATION 
FILTER FILTER 








TIMING 





TIMING 
PRE- 
AMPLIFIER 


+8.4V -84V REPEATER 
ti GROUND 
ISOLATION POWER ISOLATION 
FILTER SUPPLY FILTER 


Fig. 21 — Functional block diagram of the repeater. 
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linear signal path (lig. 10), comprising Equalizer I in the previous 
repeater, the preamplifier, Equalizer II, and the amplifier, reshapes and 
amplifies the pulse in preparation for detection. The timing path extracts 
a periodic timing wave from the signal train and generates a train of 
short sampling pulses occurring near the centers of the baud intervals, 
where the eye has its maximum opening. The regenerator provides 
crosshair pulse detection; at a time established by the sampling pulses, 
the signal pulse is compared with a threshold voltage, and if the thresh- 
old is exceeded, a new pulse is generated and transmitted to the next 
repeater. Since this is a ternary repeater, two such thresholds are pro- 
vided. A second set of short periodic pulses controls the output signal 
pulse duration by turning off the regenerator after one-half baud in- 
terval. 

The circuits shown on the block diagram of Fig. 21 were constructed 
on printed wiring boards and interconnected by sections of shielded 
transmission line on a printed interconnecting board. The development 
of the individual circuits was carried out independently between re- 
sistive terminations equal to the characteristic impedance of the trans- 
mission line used. Good cascading behavior was insured by controlling 
the forward transmission and the input impedance with load. 

The complete repeater uses 25 transistors; 14 of these are a Bell System 
pnp germanium planar design with a cutoff frequency, fr, of 4 GHz; 
9 are a Bell System npn silicon design with an fr of 1 GHz; and the 
remaining two are lower-frequency transistors of standard codes. A pair 
of gallium arsenide Esaki diodes provide the decision thresholds; a pair 
of charge storage diodes are used to generate the short sampling and 
turn-off pulses. Schottky barrier diodes are used in many circuits where 
high speed and low capacitance are required. 

The description of the repeater circuits is organized into four sections: 
reshaping by the linear signal path, retiming by the timing path, re- 
generation, and secondary features such as powering and surge protection. 


4.1 Reshaping: The Linear Signal Path 


4.1.1 Hqualization 


The overall shape of the equalization is specified by the singularities 
indicated in Table II. Since the peak output power of the repeater is 
limited, minimum noise reaches the decision point in the regenerator if 
all of the passive equalization is placed beyond the preamplifier, a source 
of the noise. It is advantageous, however, to sacrifice a small amount 
of noise performance by placing a portion of the low-frequency attenu- 
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ating equalization ahead of the preamplifier to prevent its overload by 
certain pulse sequences strong in low-frequency content. With the PST 
code, the peak amplitude of the unequalized sequence varies over a 28- 
dB range, as stated earlier. 

Once placed in front of the preamplifier, there is further advantage in 
placing this low frequency attenuating portion of the equalizer at the 
output of the previous repeater. This aids in protecting the regenerator 
against lightning and power surges, both rich in low frequencies rela- 
tive to our band of interest. 

The response characteristics and circuit configurations of Equalizers 
I and II are shown in Figs. 22 and 23. Equalizer I consists of a single 
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Fig. 22 — Equalizer I—attenuation characteristic and circuit configuration. 
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Fig. 23 — Equalizer II — attentuation characteristic and circuit configuration. 


doublet with the zero at 11 MHz and the pole at 94 MHz. Notice the 
balanced nature of Equalizer I, which couples the balanced regenerator 
outputs to the unbalanced coaxial line through a balun and the un- 
balanced power separation filter. 

Equalizer II comprises two constant F sections, each with a real zero 
and a complex pole pair. The first section has a zero at 15 MHz and poles 
at 161 MHz /-+117° and the second section has a zero at 70 MHz and 


poles at 196 MHz /+114°. 


4.1.2 Amplification 


It is the function of the preamplifier and amplifier to provide essen- 
tially flat gain while maintaining the desired equalized pulse shape. To 
accomplish this without complex delay equalization requires a band- 
width exceeding 300 MHz. The phase characteristic of this gain was 
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taken into account in the computer simulation that led to the equaliza- 
tion choice. A calculation of the gain required in the preamplifier and 
amplifier at 112 MHz is as follows: 





Cable loss 57 dB 

Iqualization loss at 112 MHz relative to minimum loss 6 dB 

Minimum loss of equalization 9 dB 

Matching padding at amplifier input to achieve ade- 6 dB 
quate return loss 

Nominal loss of variolosser (in amplifier for AGC) 5 dB 

Effective ratio of amplifier to regenerator peak power —4 dB 
outputs 

Total gain required 79 dB 


This gain is split with 26 dB in the preamplifier, and 53 dB in the am- 
plifier. 

The preamplifier curcuit, shown in Tig. 24, uses three transistors, 
each having a 4-GHz fr, in common emitter configurations with collec- 
tor to base feedback. The series diode gate at the input provides surge 
protection for the input transistor, and in the process loses 1 dB in 
noise figure and in gain. The overall circuit shown has a 6-dB noise 
figure at the frequencies of interest and a gain of 26 dB. 

The amplifier functions (2) to terminate Equalizer II accurately in 50 
ohms, (77) to amplify the signal 48 dB nominally, with an AGC range of 
+5 dB from nominal, (277) to provide balanced outputs of 1 volt across 
each of the two regenerator 50 ohm inputs, and (zv) to rectify the bal- 
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Fig. 24 — Preamplifier circuit. 
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anced output to provide signals for the timing path. A circuit diagram 
of the amplifier is shown in Fig. 25. The basic gain stages are two-tran- 
sistor doublets.8 All transistors in the forward signal path are the 4- 
GHz pnp type, except the final transistor which is the 1-GHz npn type. 
The two transistors in the de amplifier for the AGC are standard codes 
as noted. 

The AGC diode compares the positive peak equalized signal amplitude 
with a reference derived from the power supply. When the amplitude is 
too large (small) the difference is amplified and the PIN variolosser 
diode current is increased (reduced). The advantage of a PIN diode over 
a pn-junction diode is that variolosser action is not obtained by the 
nonlinear conductance of a junction, but rather by the conductivity of 
the intrinsic region, determined by the de control current. In this manner, 
currents of tenths of milliamperes are used to control signal power up to 
1 milliwatt. The AGC loop gain is 40 dB at midrange. 


4.2 Retiming 


The timing path generates two trains of periodic subnanosecond 
pulses from information extracted from the equalized pulse stream. One 
train is for timing the decisions in the regenerator; the other, of opposite 
polarity, is for control of the duration of the regenerator output pulses. 
The relative phase between the sampling pulses and the information 
pulses at the regenerator input is determined by the timing path. 

The timing path begins with the full-wave rectifier at the output of 
the amplifier (ig. 25). The diodes are biased to transmit the upper 65 
per cent of the rectified signals. This clipping level was shown to give 
best jitter performance both in an analog computer simulation of the 
timing path and in tests on the actual circuits. As indicated in Fig. 21, 
the clipped signal drives the timing preamplifier, which in turn drives a 
resonant tank tuned to the baud frequency. The output has pulse pattern 
dependent amplitude variations of approximately 14 dB; the 
+0—0+0—--- sequence gives minimum amplitude and_ the 
+—+—-+-— --+ sequence gives maximum amplitude. This signal is 
amplified and limited to obtain a uniform high-amplitude sine wave, 
which in turn is coupled to a pair of oppositely poled charge storage 
diodes to generate the two required subnanosecond pulse trains. 


4.2.1 The Resonant Tank 


The tank is a loaded cavity with inductive loops for input and output 
coupling. The loaded Q is 80. An exploded view in Fig. 26(a) shows its 
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Fig. 26 — The resonant tank; (a) exploded view; (b) equivalent circuit. 


construction, and the equivalent circuit in Fig. 26(b) shows its opera- 
tion. The resonant frequency is stabilized with respect to temperature 
by the use of invar for the center post. This frequency can be adjusted 
over a narrow range by trimming the capacitance of the tank by ad- 
justing the position of the disc attached to the trimming screw shown at 
the left end of Fig. 26(a). 

We allow a maximum of +0.1 radian (5.7°) of static timing mis- 
alignment due to tank mistuning with age (20 years), and temperature 
(a range of 40°). The phase shift, 9, of a high Q resonant circuit is 
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given for small values by 


Af 
g © 2Q5 
‘i 
where f is the resonant frequency and Af is the mistuning. Hence, for a 
Q of 80, the tolerance on the resonant frequency is 


Af +01 


F = 160 or +0.0625% 


This level of performance is attained with the machined structure of 
Tig. 26, provided that it is operated between well-controlled impedances. 


4.2.2 Anvplification in the Timing Path 


For the pulse sequence with maximum timing energy, the baud 
frequency component of the rectified timing signal has a peak amplitude 
of 150 mV. For the sequence with minimum energy, this component is 
30 mV, or 14 dB lower. The peak amplitude of the required timing am- 
plifier output is 3 volts, or 40 dB above 30 mV. In addition, as will be 
shown in Section 4.2.3, a minimum of 8 dB of limiting for the lowest 
level signal is required for good performance. Further, the tank has a 
loss of 0.5 dB at the baud frequency. Thus, linear gain of 40 + 8 + 
0.5 = 48.5 dB is required in the timing path. 

The 3-stage timing preamplifier, shown in Fig. 27, provides 22.5 dB 
of gain, and the 5-stage timing amplifier, shown in Fig. 28, provides 26 
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Fig. 27 — Timing preamplifier circuit. 
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Fig. 28 — Timing amplifier circuit. 
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dB of gain at levels low enough not to produce limiting. Each stage has 
about 8 dB of gain, but the amplifier includes a phase adjustment circuit 
with 13 dB of loss, as described in Section 4.2.4. Both amplifiers employ 
common base stages coupled by bifilar-wound transmission line auto- 
transformers to provide current gain. All eight transistors are the 1-GHz 
npn silicon type. 

As indicated in the composite frequency response of Fig. 29, the band- 
widths of the timing path amplifiers are quite broad. This broadband 
design reduces the sensitivity of the timing path phase response to 
variations in amplifier reactive elements with age and temperature. 


4.2.3 Limiting 


A series gate employing Schottky barrier diodes at the output of the 
second stage of the amplifier is used to perform limiting, as shown on 
Fig. 28. Transistor limiting was avoided in order to keep amplitude-to- 
phase conversion at a minimum. The main cause of amplitude-to-phase 
conversion in this series type of limiter comes from diode shunt capaci- 
tance. With very large signals, significant reactive current flows through 
this capacitance and advances the phase of the output wave. This effect 
is kept small by the use of the shunt diodes to reduce the voltages 
reaching the series diodes. The amplitude-to-phase conversion of the 
limiter for the 7-mA diode current used is shown in Jig. 30(a). 

Since the phases of the pulse trains generated by the charge storage 
diodes are heavily dependent upon the sine wave amplitude, the flatness 
of limiting shown in Fig. 30(b) is also important. Notice that an input 
of 0.35 volts at the lower end of the 17-dB range results in an output of 
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Fig. 29 — Composite frequency response of the timing path amplifiers. 
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Fig. 30— Limiter performance; (a) transmission phase shift vs input signal; 
(b) output signal vs input signal. 


0.14 volts. This corresponds to the 8 dB of minimum limiting referred to 
earlicr. The 17-dB range is the sum of 14 dB due to timing wave am- 
plitude variations and 3 dB due to loss variations in the phase adjust- 
ment circuit to be described next. 


4.2.4 Phase Adjustment Circuit 


In order to set the sampling pulse at the center of the eye, a phase 
adjustment is required in the timing path. The circuit at the input to 
the timing amplifier (ig. 28) was designed to permit a +45° adjust- 
ment range on the phase of the timing wave. The coaxial transmission 
line provides 90° of phase shift between the input and the upper end of 
the potentiometer. Due to the balun, there is 180° phase difference 
between the upper and lower ends. Two currents are summed at the 
emitter of the first amplifier stage. One current, Iz , at reference phase 
in the vector diagram of Fig. 31, comes directly from the input; a quad- 
rature current, Ig, comes from the movable tap. By moving the tap 
upward in the diagram, more phase lag is introduced and vice-versa. 
Over the extreme range of the potentiometer, for which J g is indicated 
by the dashed lines, 3 dB of amplitude variation is introduced, an amount 
which the limiter removes. 
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Fig. 31 — Vector diagram for phase adjustment circuit. 


4.2.5 The Short-Pulse Generator 


The circuit to generate the subnanosecond sampling and turn-off 
pulses is shown in Fig. 32. A sine wave of current from the timing am- 
plifiers flows through the diode in the forward direction, storing charge. 
During this portion of the operation, the rather small forward voltage 
drop appears across the diode. When the sinusoidal current reverses 
polarity, the stored charge permits reverse conduction. until the charge 
is depleted, whereupon the diode current abruptly falls to zero.!9:?° The 
feed inductor current is abruptly switched from the diode to the load to 
produce a rapid rise of current. The decay transient determining the 
short pulse duration is established by the coupling network with the 
diode open-circuited. 
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Fig. 32 —Short-pulse generator circuit. 


1032 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1966 


4.3 Regeneration 


Tn the regenerator, the ternary signal requires two amplitude thresh- 
olds, which are obtained by providing two identical decision circuits 
driven with oppositely phased signals from the balanced amplifier out- 
put. Each decision circuit incorporates a two-input AND gate and an 
Esaki diode, shown as part of I'ig. 33. The signal is applied to one input 
of the gate and subnanosecond sampling pulses to the other. With a 
positive signal pulse present, the sampling pulse diverts the AND gate 
current from the sampling pulse diode to the AND gate output, where 
the Esaki diode is triggered to its high-voltage state. With either a zero 
or negative input signal, the gate current flows toward the signal source, 
and the Esaki diode remains untriggered. A subnanosecond negative 
turn-off pulse, one-half baud interval after the sampling pulse, returns 
the Esaki diode to its low-voltage state, establishing the repeater output 
pulse duration of 2.2 nanoseconds. 

The Esaki diode voltages of the two decision circuits are amplified in a 
pair of current routing output stages, employing the 4-GHz germanium 
transistors. The resulting balanced outputs of these stages are combined 
to give the appropriate signal polarities at the repeater output. 
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Fig. 33 — Regenerator circuit. 
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4.3.1 Input Networks 


The inputs to the regenerator are ac coupled. The shunt capacitors 
(ig. 83) reduce timing energy coupling onto the input signal leads. 
Since the timing path begins at the amplifier output, such coupling feeds 
energy back into the timing path, thereby increasing pattern dependent 
jitter. The other elements of the input networks provide good 50-ohm 
terminations for the amplifier signals. 


4.3.2 The Threshold Circuits 


A biasing circuit fixes the de level of the signal relative to the thresh- 
old voltage, which is established by the Esaki diode. This threshold 
voltage and the signal bias are related through the back-to-back diodes 
of the AND gate to provide temperature tracking. The signal bias is 
chosen to place the Esaki diode threshold voltage at the center of the eye. 

A discussion of the operation of the threshold circuit follows. At the 
threshold of triggering the Esaki diode, with the sampling pulse present, 
equal current flows through diodes D, and Dz of the AND gate. It can 
be shown that this condition corresponds to maximum signal trans- 
mission, which provides maximum regenerator sensitivity. 

An applicable model of the Esaki diode and its sources, shown in I'ig. 
34(a), is the parallel combination of a signal current source, Js , a bias 
current source, Jz , a linear source resistance, a capacitance, and a non- 
linear resistance whose static characteristic is shown in Tig. 34(b). The 
difference between the load line current and the static characteristic 
current is capacitive current J¢ of our model. Threshold voltage V, is 
the voltage at point A, the unstable intersection of the load line and 
the diode static characteristic. Initially, the voltage is Vc, the low 
voltage state. The subnanosecond sampled signal pulse charges the 
capacitance, raising the voltage. If after this pulse has passed, the re- 
sulting voltage is greater than V4 , excess current is available to further 
charge the capacitance, stable point B will be reached, and the decision 
will be that a pulse was present. If the voltage is less than V4, the 
capacitance will discharge, operation will return to point C, and the 
decision will be that no pulse was present. 

For good dynamic performance — that is, high circuit speed at the 
threshold level — the load line should intersect the diode negative re- 
sistance at a steep part. For high circuit gain, on the other hand, the 
load line should be raised toward the peak so that smaller AND gate 
current can be used (the amplifier must supply a peak-to-peak signal 
current equal to the gate current) and larger voltage can be obtained to 
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Fig. 34— Esaki diode model; (a) equivalent circuit; (b) volt-ampere charac- 
teristic of nonlinear resistance. 


drive the current routing stages. Further, for stability against changes in 
diode peak current with age and temperature, biasing current J, should 
be small and the gate current should be large. As a suitable compromise 
among these factors, a bias current of 8 mA and a gate current of 4.5 
mA were chosen in conjunction with a gallium arsenide Esaki diode 
having a peak current, Jp , of 10 mA. 

The input-output dynamic regenerator characteristic was calculated 
using the equivalent circuit of Fig. 34(a) and a piece-wise linear approxi- 
mation to the diode characteristic of Fig. 34(b). The performance was 
measured for six regenerators in the experimental setup of Fig. 35(a). 
A comparison of the limits of the measured characteristics and the calcu- 
lated characteristic is shown in Tig. 35(b). It was indicated in Section 
3.2.2 that the total area and not the amplitude of the regenerator output 
pulse primarily controls the amplitude of the pulse arriving at the sub- 
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sequent regenerator after transmission and equalization. Hence, the 
use of the simulated equalized line for 7(f) permits the proper com- 
parison of equalized amplitudes, Vout. 


4.3.3 Output Amplifiers 


The emitter-coupled current routing pair of Fig. 33, which amplifies 
the Esaki diode voltage, has five important features. First, the circuit is 
fast because of the prevention of saturation. Second, it performs the 
inversion required for the negative pulse decision circuit. Third, its 
nonlinear forward transmission characteristic provides additional am- 
plitude regeneration. Fourth, it has good de temperature stability due 
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Fig. 35 — Input-output dynamic regenerator characteristic; (a) experimental 
setup; (b) measured and calculated characteristic. 
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to the oppositely poled emitter junctions between the signal and the 
reference inputs. (The Esaki diode signal voltage is a unipolar pulse 
stream which includes a de component.) Fifth, to a first approximation, 
signal currents flow equally and oppositely in the two output leads and 
thus no current from the output flows through the ground system of the 
repeater. Many kinds of repeaters powered serially over the trans- 
mission line suffer from feedback problems due to such currents. 

The output collectors of the two current-routing circuits are paralleled 
into balanced 75-ohm loads, to which they deliver peak output voltages 
of 1.5 volts of each polarity. 


4.4 Secondary Features 


4.4.1 Power Arrangement 


Repeaters are powered serially by de over the center conductor of the 
coaxial. The line current is 450 mA. Power supply voltages in the re- 
peater are obtained by passing about 50 mA of this current through a 
series pair of 8.4-volt Zener diodes as shown in Tig. 36. Thus, cach re- 
peater consumes 7.5 watts. 

In Fig. 36, we show only the circuit elements required to separate the 
de power from the signal. Feedback from output to input is attenuated 
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Fig. 36 — Repeater powering circuit. 
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in the power circuits by greater than 1380 dB over the signal frequency 
range. 

It is difficult to prevent spurious signals from appearing between earth 
ground and local repeater ground. In a long system, these two grounds 
may differ by as much as 1000 volts de and capacitors with adequate 
voltage rating have appreciable impedance at frequencies of interest. 
Tiltering inductors are required to prevent these ground-to-ground 
voltages from affecting the sensitive repeater circuits. The philosophy 
here is to isolate the repeater circuits from earth ground as much as 
possible. 


4.4.2 Surge Protection 


Partial surge protection has been provided at both the input and the 
output of the repeater. At the input, a series diode gate (Fig. 24), with 4 
mA of current through each diode, limits the surge at the base of the 
first transistor. At the output, Equalizer I reduces the low frequency 
power which could harm the transistor collectors. These surge protection 
features are laboratory precautions only. Complete protection against 
lightning and power surges has not been accomplished in this experi- 
mental repeater. 


4.4.3 Repeater Equipment Design 


The repeater circuits shown on Fig. 21 were constructed on printed 
wiring boards which plug into a 3-layer printed wiring interconnecting 
board. The plug-in boards are attached to aluminum backing plates 
which provide support and an electrical ground plane for the circuits. 
The plates slide into the grooved sides of pockets in an aluminum in- 
vestment casting. Fig. 87 is a photograph of a repeater showing the 
circuit boards in place in the casting, except for the amplifier board 
which has been removed. Shielding covers have been removed and are 
not shown. 

Printed wiring carries shielded de power to the individual circuit 
boards from the power supply on the interconnecting board (at the back 
of the casting in the photograph). Signal interconnections are made by 
miniature coaxial transmission lines to provide shielding. 

Tantalum thin-film integrated techniques were considered for the 
circuits of the repeater, and there appear to be no fundamental ob- 
stacles to their use. A thin film version of the preamplifier was built and 
performance was equal to or better than the printed wiring version. 

The size of this repeater is approximately 4x5x11 inches for a volume 





Fig. 37—Photograph of repeater with the amplifier printed circuit board 
been removed and are not shown. 


removed. Shielding covers have 
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of 220 cubic inches. By design, there is access space for testing of the 
experimental repeaters. It is anticipated that the use of integrated cir- 
cuits and the elimination of excess space will result in a design occupying 
about one-quarter of the volume. 


V. EXPERIMENTAL PERFORMANCE 


In this section, we report on the performance of the line under labora- 
tory conditions. In general, the line has met all performance expectations 
under these conditions. For volume manufacture, however, and for 
operation under field conditions for many years, further development is 
required. By the work reported on here, we have established the technical 
feasibility upon which a design for service can be based. 


5.1 Hrror Rate 


The line operates at error rates below 107~!° errors per baud through 
ten repeatered links. 


5.2 Jitter 


According to our model, each repeatered link introduces a pattern 
dependent, or systematic, component of jitter which is dominant. Pat- 
tern independent jitter tends to be random at each repeater; hence, it 
accumulates much more slowly and is negligible at the end of a long 
chain. 

Since pattern dependent and pattern independent jitter are indis- 
tinguishable by measurement of a single link, we measure the jitter at 
the end of the chain. To determine the systematic component for the 
single link, we apply an equation derived from the model: 


= PCL) 
a Vay 


where 6; is the systematic rms jitter arising in each link, @y is the syste- 
matic rms jitter at the end of N links, and P(N) is given by 


N (2N—-1)! 
EM) ~ 2 4xi(N — 1)IP 


This function is tabulated in Ref. 8. For ten links, the above expression 
becomes 


6, = 0.247 Oy. 
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For only ten repeaters, the nonsystematic component may not be 
negligible, so that this calculation gives only an approximation to the 
systematic jitter contribution per link. 

The total measured jitter at the end of our ten links is 13.3° rms. If 
we assume this to be all systematic, we calculate a per-link systematic 
jitter contribution of 3.3° rms. This laboratory measurement is well 
within the 8° objective of Section 3.3.2. 

Tig. 88 shows the measured accumulated jitter versus the number of 
repeatered links. The intercept (NV = 0) accounts for jitter introduced 
in the transmitting and receiving repeaters at the ends of the line. 


5.3 Waveforms 


In Fig. 89 we show some of the key waveforms in the repeater. All the 
waveforms are aligned in time for clarity. Fig. 39(a) shows the regenera- 
tor output before Equalizer I; 39(b), the signal input to the positive 
decision threshold of the regenerator; 39(c), the eye at this point when 
the line is driven by a random binary sequence; and 39(d), the sub- 
nanosecond sampling and turn-off pulses. For instructional purposes, 
the eye diagram has been synchronized at an even submultiple of the 
baud frequency to show the paired nature of the PST signal. The tim- 
ing extractor causes the distortion in the negative eye. This distortion is 
of no consequence since only the positive eye is used by the positive 
threshold. 
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Fig. 38 — Measured accumulated jitter (rms) vs the number of repeatered links 
in the experimental line. 
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Fig. 39—Key waveforms in the repeater; (a) regenerator output before 
Equalizer I; (b) signal input to the positive decision threshold; (c) the eye at the 
positive decision threshold; (d) the subnanosecond sampling and turn-off pulses. 
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VI. CONCLUSION 


Ten 224-Mb/s experimental digital repeaters and associated code 
translation equipment have been developed, constructed, and operated 
over 10 miles of 0.270-inch coaxial line under laboratory conditions. The 
resulting performance has indicated that such a line 4000 miles in length 
is feasible for actual service and can be designed with existing techniques. 

The transmission code is paired selected ternary (PST) which provides 
the essential features for the repeater operation as well as for in-service 
error monitoring. 

Each repeater employs 25 transistors, most of them of a pnp ger- 
manium planar epitaxial design with an fr of 4 GHz. The decision ele- 
ments are gallium arsenide Esaki diodes, 

The repeaters are serially powered by de over the line with 450 mA 
of current, and each repeater consumes 7.5 watts. 

Good agreement among theory, simulation, and laboratory perform- 
ance has been achieved throughout. The error rate per repeatered link 
under laboratory conditions is less than 10-" and the systematic jitter 
introduced in each link is about 3° rms. 
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Difference-Set Cyclic Codes 


By E. J. WELDON, JR. 


(Manuscript received January 14, 1966) 


Codes exist which are capable of correcting large numbers of random 
errors. Such codes are rarely used in practical data transmission systems, 
however, because the equipment necessary to realize their capabilities — that 
is, to actually correct the errors — 1s usually prohibitively complex and ex- 
pensive. The problem of finding simply implemented decoding algorithms 
or, equivalently, codes which can be decoded simply with existing methods, 
is perhaps the outstanding unsolved problem in coding theory today. 

In this paper, a new class of random-error-correcting cyclic codes is de- 
fined. These codes have two very desirable features: the binary members of the 
class are nearly as powerful as the best-known codes in the range of interest, 
and they can be decoded with the simplest known decoding algorithm. 
Unfortunately there are relatively few codes with useful parameters in this 
class, despite the fact that the class 1s infinite. 


I. INTRODUCTION 


The Bose-Chaudhuri'-Hocquenghem’ (BCH) cyclic codes are, as a 
class, the best of the known, constructive, random-error-correcting 
codes. Fortunately a decoding algorithm, which can be implemented 
with a reasonable amount of equipment, has been found for these 
codes.°*"” 

In this paper, a new class of random-error-correcting cyclic codes is 
presented. These codes can be implemented much more simply than the 
BCH codes and are approximately as powerful. Unfortunately, the class 
is a small one. 


II. DIFFERENCE-SET CYCLIC CODES 


A simple perfect difference set of order J and modulus n = I(J — 1) 
+ 1 is defined as a collection of J integers chosen from the set {0, 1, 
--+, 2(1 — 1)} such that no two of the (1 — 1) ordered differences 
modulo n are identical. That is, each occurs once. Singer® has shown 
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how to construct such sets when 1 = p* + 1, p prime, s a positive inte- 
ger, while vans and Mann’ have shown that a perfect difference set 
cannot be constructed for any other value of 1 S$ 1600. 

Since adding a fixed integer to every element of a perfect difference 
set clearly results in another such set, no loss of generality is suffered by 
considering only sets containing the element 0. In what follows, all 
perfect difference sets will be of this type. 

Denote the elements of a perfect difference set of order p* + 1 by 
dy = 0, dz, --+ , dps 41 and let 


Oz) = a alt foes 4 lt 


be a polynomial in the algebra of polynomials modulo 7” — 1. The coef- 
ficients of all polynomials are taken from GF (p'), r S s. Consider the 
n-by-n cyclic matrix 0 over GF (p’) whose rows are the coefficient vectors 
of 6(x), xO(x), --- , e” 0(x). For reasons which will become apparent 
shortly, the subspace of n-tuples generated by the rows of this matrix, 
which is an ideal in the algebra of polynomials modulo «” — 1, will be 
considered to be the null space of a cyclic code of length n. The rank 
of this matrix, which will be shown to be the number of check symbols 
in the code, can be determined as follows. Consider the product 


0(a)0(x *) = 1 ae xa” + git 4s 4+ Lawes = gaps +1 
ee at ce 
eo pp perind as gies ti—da ae aetkcs ae 1. (1) 
Since the d; are elements of a perfect difference set, each integer 1, 2, 
-, mn — 1 appears as an exponent in this polynomial exactly once. 
Thus, in the algebra of polynomials modulo x” — 1, 
O(c)O(Qa")Heptitatet-e- a”. (2) 


The reciprocal polynomial of 6(x), which is denoted by 6” (x), is 
equal to «esr °F @).9 (47), Since p> = 0 mod p’, (2) reduces to 


(x — 1)0(x)6"(x) = 0 
q(x) (x" — 1) (3) 
for some polynomial q(x).f Let 6(7) = f(x)h(x) where h(x) is the 


I 


If the code symbols are chosen from GF((p’)"), p’ a prime not equal to p, 
then GCD(6(x),2" — 1) equals a nonzero ground-field element, and the code speci- 
nee by h(x) is the trivial code which has n parity checks and no information sym- 

ols. 


DIFFERENCE-SET CYCLIC CODES 1047 


greatest common divisor of 6(z) and x” — 1. That is, 
h(x) = GCD(@(x), x” — 1). (4) 


As a result the ideals (cyclic codes) in the algebra of polynomials modulo 
x” — 1 generated by @(x) and h(x) are identical. Thus, the rank of the 
matrix 6 is simply m minus the degree of h (2), i.e., the number of check 
digits in the code generated by g(v) = (#” — 1)/h(x). 

In an accompanying paper, Graham and MacWilliams prove that 


there are exactly 
n-k=[(?F1)P 41 (5) 


check symbols in a difference-set cyclic (n,k) code over GF (p). But since 
6(a) and x” — 1 are both polynomials over GF (p), so are h(x) and 
g(x), regardless of the field from which the code symbols are chosen. 
Thus, (5) holds over GF (p’), r S s, as well. 

Although the derivation of (5) is fairly involved, it is easy to see that 
n—k Ss (n+ 1)/2. For each zero of 2” — 1 except unity must be a 
zero of either 6(x), 6*(x) or both, so it must also be a zero of either 
h(x), h* (x) or both. That is, 


(a — 1)h(a)h* (x) = r(x) (x” — 1) 


where r(x)f(x)f* (x) = q(x). Therefore, the degree of h(x) that is, k, 
cannot be less than (n — 1)/2andn—k S (n+ 1)/2. 

As defined, g(a) is the generator polynomial of the code whose null 
space is generated by h(x). Two polynomials multiply to zero in the 
algebra of polynomials modulo x” — 1 only if the dot product of their 
coefficient vectors, with the order of the components reversed in one 
of them, is zero. Thus, the coefficient vectors of 6*(x), x6" (x), ---, 
az” '@*(x) are in the null space of the code generated by g(x). Each of 
these vectors represents a generalized parity check equation on certain 
symbols in each code word. Since each of these equations has p* + 1 
nonzero terms, each of the n symbols in every code vector is involved 
in exactly p° + 1 equations. This follows from the fact that all the rows 
of the matrix @ are cyclically shifted versions of the first row and thus 
all columns and rows have the same weight. Furthermore, because a 
perfect difference set generates each difference exactly once, no two of 
the p* + 1 equations which check a particular symbol can both check 
any other symbol. For if they could, this would imply that some differ- 
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ence was generated twice by the perfect difference set, which is impossi- 
ble. 

Consequently, these equations form an “orthogonal check sect” of 
order p> + 1 on the symbol in question. Massey” has defined such a set 
to consist of a collection of equations, all of which check a particular 
symbol, with the property that no two symbols appear together in 
more than one equation. He has shown that if it is possible to form an 
orthogonal check set of order d — 1 on any symbol in a cyclic code, 
then the code has minimum distance at least d and can be decoded with 
majority-logic decoding. Thus, difference-set codes have minimum dis- 
tance at least p* + 2 and, as described in Section ITI, can be decoded 
in a very straightforward manner. 

Although codes exist over all finite fields, binary codes are, from a 
practical viewpoint, the most interesting. Table I contains a list of the 
first few binary difference-set codes and their generator polynomials. 
These codes have several interesting properties. For example, let d’ 
denote the minimum distance of a code which can be realized by thresh- 
old decoding and let d denote the minimum distance of its dual code. 


Taste [—Lisr or Binary DIFFERENCE-SET Cycuic CopEs 





: . F 228 ; om » ee aa aa DEC eae 

1 7 3 4 1 | 4,3,2,0 3,2,0 

2 a! 11] 6 2 | 10,7,6,4,2,0 11,8,7,2,0 

3 73. | 45 | 10 4 | 28:25 22 16,12,8,6,4,2,0 | 45,42,36,29,25,24,10,2, 
0 

4 273 | 191 18 8 | 82,77,76,71,67,66,56,52,48,! 201 ,196,186,167,166, 


40,36,34,24,22,18,10,4,0|  159,128,126,115,112, 
103,67,50,46,24,18,0 
5 | 1057 | 813 | 34 | 16 | 244,242,936,234,232 228, | 1023,990,924,905,879, 
226, 224,222,216,214,212,| 792,754,702,697 ,677, 
211,210,209 208,203,202, 597,555,528,511,452, 
201,200,199 198,195,194, 439.348 338,298,277, 
193,191,189,188,186,184,/  255,219,138,127,109, 
183,182,181,180,179,178,|  63,54,31,15,7,3,1,0 
177,176,175, 174,169,167, 
166,165,164,161,160,158, 
155, 154,153,151,150,149, 
147 146 142,141,138, 137, 
135,132,131,129,126,124, 
123,122 121,120,116,115, 
114,111,108, 106,105,103, 
101,98,96,95,88,83,81, 
79,76,75,74,72,71,70,68, 
62,59,55,52,51,48.47,45, 
43.41.3937 ,35,33,32,28, 
27°26,23,22,18.17,14,11, 
5,4,3,1,0 
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Since any symbol appears in all equations orthogonal on that symbol 
and no other symbol appears in more than one of these equations, it is 
clear that the following bound holds for all block codes decoded with 
threshold decoding: 


S161) Sa, (6) 


For difference-set codes d’ = 2° + 2, and in the binary case at least, 
d = 2° + 1, the weight of 6(x).* Thus, the equality holds in (6) and the 
codes are, in this peculiar sense, optimal. 

In summation, it has been shown that there exists a class of cyclic 
codes of lengthn = p* + p* + 1, i.e., those generated by g(x) = (2"— 1) 
/h(x) where h(x) = GCD (6(x), x” — 1), which have 


ery 


parity symbols* and which have the polynomials 6(x) and its multiples 
in their null spaces. Because of this latter property, the codes have mini- 
mum distance of at least p* + 2. Also, in what follows, it is shown that 
this property can be used to implement these codes as random-error 
correctors in a remarkably simple manner. 


III. IMPLEMENTATION 


Because the codes are cyclic they can be encoded simply. See pages 
148 and 149 in Peterson.” 

Massey’s majority-logic implementation of Meggitt’s" general decoder 
for cyclic codes can be used to decode difference-set cyclic codes. A 
decoder of this type is shown in Fig. 1; it operates as follows. With the 
switch in the D position, the k-symbol data sequence is shifted into the 
syndrome and data registers simultaneously. When the entire data 
block has been entered, the switch is thrown to position P and the n-k 
received parity checks are shifted into the syndrome register, forming 
the syndrome. At this time, the output of the majority gate equals the 
additive inverse of the noise digit which was added to the first data 
symbol by the channel, provided that fewer than p*” errors occurred 
in the word.} Consequently, all that must be done to correct the first 
symbol is to add the output of the majority gate to the received sym- 
bol. This is done by the adder (@) during the first shift of the registers. 

+ The majority gate has the following characteristics: Its output equals the 
additive i inverse of the ground-field element which occurs most frequently among 


its p*’ + 1 inputs, provided that that element occurs at least p** + 1 times. Other- 
wise it equals zero. 
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Fig. 1 — Fixed threshold majority-logic decoder for difference-set cyclic codes. 


Because of the cyclic nature of the codes, repeating this process k times 
corrects all errors in the data section of the word. 

Performance can be improved slightly at virtually no cost by the 
addition of the dotted connection and its associated adder to the de- 
coder. This circuit removes the effects of corrected errors from the 
syndrome as the errors are corrected. This can be seen as follows. The 
first (highest-order) data symbol is checked by the parity check sym- 
bols stored in the shift register stages just to the left of the feedback 
connections. (This can be seen by examining the generator matrix of 
the code in systematic form.) If a particular ground-field element is 
added to the first information symbol to correct it, in order to remove 
the error from the parity check equations which checked that symbol, 
it is necessary to add the same ground-field element to each of these 
parity check symbols. This can be accomplished by adding the symbol 
to the feedback signal and shifting the register once. Successive correc- 
tions can be made in exactly the same manner. 

Although a code will correct all error patterns of weight not greater 
than p* * and some of greater weight if this connection is omitted, many 
more patterns of weight greater than p*” will be corrected if it is in- 
cluded. 

The presence of this connection also enables the decoder to detect 
undecodable error patterns. This is done by shifting the syndrome 
register n — k times after the data symbols are corrected. A decodable 
pattern will have an all-zero syndrome after correction, while an un- 
decodable pattern will not. 
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The connections from the syndrome register to the p’ + 1 summing 
circuits are made as follows. Each of the p* + 1 equations orthogonal 
on the first information symbol involves one or more parity check sym- 
bols. The sum modulo p’ of all check symbols involved in the 7th equa- 
tion, 7 = 1, 2, ---, p +1, equals the zth check sum orthogonal on the 
first information symbol. Thus, the inputs to the 7th summing circuit 
are simply those parity check symbols involved in the 7th equation. 

This point is illustrated in Fig. 2 in which the decoder for the (73,45) 
binary code listed in Table I is depicted. Table IT lists the 28-bit parity 
check sections of the nine composite parity check equations orthogonal 
on the first information symbol. Each of these equations manifests 
itself as one of the nine inputs to the majority gate of Fig. 2.7 

A modification of threshold decoding, Variable Threshold Decoding, 
has been used to decode quasi-cyclic codes.” It can also be used here to 
improve performance somewhat, at the cost of a slight increase in 
complexity. Instead of keeping the threshold set at p*’ + 1, it is ini- 
tially set at its maximum value, p* + 1, and an attempt is made to de- 
code each of the n symbols of the received word. When an n-symbol 
cyclic revolution of the syndrome has been completed without any 
changes being made, the threshold is reduced by one and another attempt 
is made. If another complete revolution is made with no changes, the 
threshold is lowered again. If a change is made, however, the threshold 
is immediately raised by one and decoding continues. Upon the com- 
pletion of the revolution, the threshold is again lowered by one. 

Eventually one of two things must occur. Either the threshold will 
drop to its minimum value and remain there, or it will enter into some 
sort of limit cycle wherein it changes repetitively between two or more 
levels. In a practical system this latter difficulty can be obviated by ter- 
minating decoding after a fixed number of attempts, and if it is ap- 
propriate, signaling a detected error if the syndrome is not all zeros. 
It seems likely that roughly 2d cyclic revolutions of the word will suffice 
to decode nearly all decodable error patterns. 


IV. A COMPARISON 


In an unpublished report,” the author estimated that approximately 
3600 transistors would be required to instrument a decoder for the 
(273,200), d = 18, code formed by shortening the (511,438) primitive 
BCH code.{ Also it was estimated that the decoder’s internal circuitry 

+ Using a combination of sequential and combinational circuits, rather than 
strictly combinational circuits, would undoubtedly result in a slightly cheaper, but 


conceptually more complex decoder. 
t This was before Berlekamp’s work.” *° 
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Fig. 2— Decoder for (73, 45), d = 10, binary difference-set cyclic code. 
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would have to operate roughly 85 times faster than line speed to enable 
it to keep up with the data. These estimates were based on the assump- 
tions that only transistor storage was used and that speed would be 
sacrificed to reduce the number of transistors needed whenever practical. 
For example, the decoder is a serial, rather than parallel, device. 

Assuming that the syndrome register, exclusive-OR circuits and ma- 
jority gate are duplicated, the internal circuitry of the decoder for the 
(273,191), d = 18, binary difference set code can operate at line speed. 
The numbers of transistors required for the various decoder components 
are tabulated below. 


Circuit Function Number of Transistors 

Data register 382 
Syndrome registers (2) 328 
E:xclusive-OR’s 400 
Majority gates (2) 40 
Clock and switches 30 
Miscellaneous 20 

Total 1200 


The complexity of the two decoders is compared in the following 
table. 


Decoder 


Clock Rate Ease of Design, 
Number of (multiples of Construction, 
Decoder for Code Efficiency Transistors line bit rate) & Testing 
BCH Code 0.73 3600 85 difficult 


Difference-Set Code 0.70 1200 1 very simple 
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This type of comparison is quite crude and is admittedly chosen to 
illustrate the strong points of difference-set codes. Also, in light of 
Berlekamp’s work,®: }° it may be possible to reduce the number of tran- 
sistors required for the BCH decoder by as much as a factor of two and 
its speed by twice that. However, despite these facts, the difference-set 
decoder remains a much simpler piece of equipment than the BCH 
decoder. Also, a comparison of longer, more powerful codes would 
demonstrate the relative simplicity of the difference-set decoder even 
more dramatically. 

This comparison is not intended to demean the BCH codes or their 
very elegant and general decoding algorithm. There are certainly many 
cases, in fact nearly all cases involving long, relatively efficient random- 
error-correcting codes, in which they are by far the most easily imple- 
mented codes. Rather, the comparison is simply intended to point out 
that, in certain cases, difference-set codes are much easier to implement 
that the BCH codes, and to suggest that there may be other classes of 
cyclic codes for which the same is true. 


V. CONCLUSIONS 


A new, relatively small, class of random-error-correcting cyclic codes 
has been presented. These codes, which are approximately as powerful 
as the best cyclic codes for given values of efficiency and length, are 
very easily implemented. Consequently, they are concluded to be at- 
tractive for use in error-control systems where forward-acting random- 
error-correction is required. 


VI. ADDENDA 


Subsequent to the discovery of these codes, the author became aware 
of the unpublished, but earlier, work of L. D. Rudolph.” In it a class of 
threshold-decodable codes, which contains the class of difference-set 
cyclic codes, is described. Also, (6) has been derived by Mitchell in 
Ref. 15. 
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On the Number of Information Symbols 
in Difference-Set Cyclic Codes 


By R. L. GRAHAM and JESSIE MACWILLIAMS 
(Manuscript received April 28, 1966) 


The concept of a difference-set cyclic code has been described previously. 
It was shown that such a code is almost as powerful as a Bose-Chaudhurt 
code and considerably simpler to implement. It is the purpose of this paper 
to determine some of the more important properties of this code and its dual 
code (cf. Sec. IV). It may be pointed out that the problems we consider are 
equivalent to determining certain properties of incidence matrices associ- 
ated with a class of balanced incomplete block designs formed from simple 
difference sets. 


I. INTRODUCTION 


The concept of a difference-set cyclic code has been described by E. 
J. Weldon, Jr. in the preceding paper.! In Ref. 1 it is shown that such a 
code is almost as powerful as a Bose-Chaudhuri code and considerably 
simpler to implement. It is the purpose of this paper to determine some 
of the more important properties of this code and its dual code (cf. Sec. 
IV). It may be pointed out that the problems we consider are equivalent 
to determining certain properties of incidence matrices of Desarguesian 
planes. 


II. SIMPLE DIFFERENCE SETS AND ASSOCIATED CYCLIC CODES 


A simple difference set S is a collection of J integers {di,--- , di} 
modulo » such that every a # 0 (mod n) can be uniquely expressed in 
the form 


d; — d; = a (mod n), 
for some d;, d; m S. Of course, n = 1(1 — 1) + 1. If 0(x) (the differ- 
ence-set polynomial) is defined by 
l 
a) Das 
i=1 
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then it follows that 
n-1 
6(x)o(a*) = 1+ >> x (mod(z” — 1)). 
i=1 


This may be written 
6(2)0(a') = (L— 1) + (@” — 1)/(@ — 1) (mod (2” — 1)). 


Changing to arithmetic over the finite field G/'(p), where p is a prime 
that divides 1 — 1, we have 


(x — 1)0(x)0(2") = O (mod (az” — 1)). 


This means that @(2) has a nontrivial highest common factor h(a) in 
common with x” — 1 over GF (p). 

Let R be the ring of polynomials modulo x” — 1 over GF (p). The 
ideal R-6(x) is the same ideal as R-h (a) and is a proper ideal in FR, and, 
in fact a cyclie code (see Ref. 5, Section 8.1). The dimension of this 
code is (n — deg h(a)).* 

The only known simple difference sets are obtained by a construction 
due to Singer.” For this construction, n must be of the form p™ + p* + 1. 
Hence, 1 — 1 = p’, which determines the finite field one must use. lor 
p = 2and1 S s S 5, the dimension of R-@(~) was found by E. J. 
Weldon, Jr. to be 3° + 1. In this paper it is shown that in general the 


dimension of R-6(2) is C a :) +1. 


III. AN EQUIVALENT PROBLEM 


Letn = p+ p+ 1r =p’ — 1. {di, de, +--+ , di is a Singer dif- 
ference set modulo n, and @(x) the difference-set polynomial. In this sec- 
tion all arithmetic will be in GF (p) (addition and multiplication mod p) 
unless otherwise specified. 

The degree of h(x) is the number of zeros of x” — 1 which are also 
zeros of 6(a). Hence, the following odd-sounding theorem is relevant. 


Theorem 1: The number of nth roots of unity (over GF (p)) which are not 
zeros of O(a) is the number of integers t, 1 S t S n, such that for some 


j, 1 Sj St — 1, the binomial coefficient (5) is not zero (mod :p). 


* This roundabout approach is usual in coding theory. Appendix B contains a 
direct proof that the dimension of R-6(x) is the number of zeros of x” — 1 which 
are not zeros of 6(x). 
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The purpose of this section is to prove Theorem 1. Several preliminary 
steps are needed. 

Let v be a primitive nrth root of unity over GF (p); » = v" is a primi- 
tive rth root of unity, ¢ = »v’ is a primitive nth root of unity. The first 
n powers of ¢ are the zeros of x” — 1; the degree of the highest common 
factor of 6(x) and 2” — 1 is the number of integers ¢ S$ n for which 
a(s) = 

The powers of w generate GF (p*), and, since nr = p* — 1, the powers 
of »y generate GF (p*). Since GF (p*) D GF (p’), any linear combination 

;;'v’ is again a power of ». 

To construct a Singer difference set modulo n, one picks two arbitrary 
enact riteeer dy , dy (less than n), forms all linear combinations 


1 +. wy? = yp and replaces v’ by wy (dy < n) by using »” = w 
ie. Ref. 2). The distinct exponents of y which are obtained in this way 
form a Singer difference set.* Since w'(w'v + wp”) = wf y, each 


exponent d; will be produced 7 times; we can get each one exactly once 
by using the equations 


d d hg d 
pr te yp? = yt ys 


d d ia 
wri tyr =a, 


(1) 
ange + ie? — wt yt 
where 
=p tl =r+2. 


Lemma 1: ¢' is a zero of 6(x) if and only if 


t—1 
a Cee = 0 
7=1 yr 


Proof: Raising (1) to the power tr gives the set of equations 
(py of pit)!" = (otr)” = (v3) = ci 
(wr af yi?) ae (p"4)" es co 


Ci ote yi?) ae (pt) = et, 





* An example is given in the appendix. 
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Thus, 
ae!) = DED" =0 
if and only if 
(vt) (p28)! a (wv +o)" = 0, 
This may be rewritten as 


r—1l1 tr-1 7 ; 
Ce at as a Cid ee al ae (yr, 


t=0 A=1 . 
where 
on = dyh + do(tr — h). 


Since r + 1 = p* the first two terms are zero; the remainder is 


> (jr) p> (w")*, 


h=1 
Now, 
rai : 0 if h #Omodr, 
> (w")* = 
1=0 ae Ge aa 


In particular (for é = 1) ¢ is a zero of 6(x). Since 
r=-lmodp, v =f, and oj = (di — de)jr +ird, 


the expression for 6(¢') becomes 


t-1 /,, 
igh (: ae 
=1 \JT 


which proves the lemma. 


Lemma 2: 


sy. eee 
3 ed ae 
3) =~ 


7=1 


4 and only af 


ee eee ern 


|) =0(modp) for j 


Proof: The difference set {d1,d2,--- ,d:} may be obtained by picking 
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any two distinct d;, d; contained in it, and applying the construction 
previously described to »*‘, »*7. By the definition of a difference set we 
may choose d; — d; to be any number 1, 2, --- , m — 1. Thus, @(¢’) = 0 
implies 


t-—1 tr : 
Oe = 0 for we), 2: es, = 1 


t1 /a\ 
> (‘ )e = 0 
7=1 \J? 


will have (n — 1) nonzero roots. Since ¢ S n this is impossible unless 
all the coefficients are zero. This proves the lemma. 

The experimental evidence (for p = 2,1 < s S 5) showed that the 
number of ¢' which are not zeros of 6(x) is 3° + 1. We guess (it turns 
out correctly) that “+1” corresponds to t = n,—¢” is not a zero of 
6(x), since 6(1) = 1 (mod p) —, and that it will be simpler to count bi- 
nominal coefficients which are not divisible by p. The information con- 
tained in Lemmas 1 and 2 is rephrased in the form of Theorem 1. 

The following corollary is immediate. 


and the equation 


Corollary 1: The degree of the highest common factor (over GF (p)) of 
6(x) and x" — 1 is the same for every Singer difference set. 
IV. A THEOREM ON BINOMIAL COEFFICIENTS 


In this section, we change to ordinary arithmetic (instead of mod p) 
and count the number of integers ¢ which satisfy the conditions of Theo- 
rem 1. In particular, our goal is to establish 


Theorem 2: The number of t,1 St S p*® + p’, for which 
tr 
(0°) #0 (mod p) (2) 


forr = p — 1andsomej,1S7< io just (? : ys 
The proof of this result will depend upon several lemmas. We first need 


some notation. Let P,(u) denote the greatest power of p which divides wu. 
If wu is written to the base p, 1.e., 


h 
u= >> wp’, 0=u < 2D, 
i=1 


1062 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1966 


for some h, then D(w) will denote* the sum of the “digits” of u, i.e., 
h 
i=1 


As usual, we let [wu] represent the greatest integer not exceeding wu. 


Lemma 3: 


(" si ") # 0 (mod p) 


af and only uf 
typ Ue SP oA, j = 0, 1, 2, --- 
Proof: It is well known that 


Pega BH 


i=1 Lp’ 


(the upper limit © is convenient, but not necessary ). Since 


P, ((" af ")) = P,((u + v)!) — Pp(u!) — Pv), 


we have 


if and only if 





ELS] ell + ele, @) 


But it is always true that 


Le pegyl el  tah s 
so that (3) holds if and only if 


jet] =[*]+[4], i= 1,2,3,-°°. (4) 
p' Di p' 


Noting that, in general, [x/p'] is just one of the “digits” in the repre- 
sentation of « to the base p:, we see that (4) is exactly the condition that, 


* We should more accurately denote this by D,(u) but since p is fixed in this 
argument, no confusion will arise. 
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for each 7, the jth digit in the representation of u + v to the base p is 
just the sum of the jth digits of u and v. Hence, (4) holds if and only if 
uprwusp = 1, PSO es 


and the lemma is proved. 
We note asa 


Corollary: 
Du +v) S Du) + D0) 
with equality uf and only af 
Ujtv;Ssp—l, fe ae ee 


We recall that the numbers of particular interest are 


uUu=*7r, v= ir — jr, 
where 
s—1 
r=p—1= > wp' (where w = p — 1). 
7=0 
Lemma 4: 
Dir) = sw for Sts r. 
Proof: Set 


s—1 


t= > ap’ + a, 


Naas | 


where we may take ap ¥ 0, since D(p*u) = D(u). Now, 


1 


ao’ = (ao — 1)p' + Dy wp’ + (p — a). 


=] 


Consequently, 


s—l 
ir = (p — 1) >> ap" + aor 
i=1 
sl 


s—l pa 
~ Saat — Fant + (a 19 + Eup! + a 


ore ; s—1 
= > ap? + (ao — 1)p* + S (w — a;)p' + (p — a0). 
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Thus, 
s—l1 s—1 
D(tr) = 2s ai + (a9 — 1) + (s—1)w — Do a: + (p — a) 
i= i=1 


= sw for lstsr=p -—l1, 


which proves the lemma. 
Note that if 1 < t < n, there is a 1 to 1 correspondence between ¢ 
such that D(tr) = wand such that D(ir) = 3sw — n. For 


0< (p* —1) —t = (n—2t)r 
and clearly 
D((n — t)r) = 3sw — Dir). 
Lemma 8: 
sw < Ditr) S 2sw, for 1St<n. 


Proof: We show that D(tr) S 2sw; the other inequality is then immedi- 
ate by the preceding remark. 
Since ¢ S p” + p* we have either 


s—1 


fe po" ob 2 up" 


or 


of. 
| 


s—1 s—1 . 
p > bip’ ate » ap’. 


In either case, let ¢; denote the first summand and ft, denote the second 
summand (so that t = 4+ &). 
By Lemma 4 


D(hr) = D(br) = sw. 
Hence, 
Ditr) = D(tr + tr) S D(hr) + D(tr) = 2sw 


and the lemma is proved. 

We recall now that in Theorem 2 we are considering integers ¢ which 
satisfy (2). By Lemma 3, this is equivalent to finding 7 and ¢, with 
1 <j <t<_n, such that 


Dir) = Dr) + D(E¢ — j)r). 


INFORMATION SYMBOLS 1065 


But Lemma 5 implies 
2sw 2 Di(tr) = DYr) + D(C — Z)r) 2 sw + sw = 2sw. 

Hence, we must have 

Dir) = 2su, Dgr) = D(@—Jj)r) = su. 
On the other hand, suppose for some u, 1 S u < n, we have 

Dur) = 2sw. 
Let h denote P,(u) and set u = p*u’. As in Lemma 5, set 
= uy + Us , 
where uw < rand D(w’r) = sw. Since 
D(u'r) = D(ur) = 2sw 


then we must have D (uy 7) = sw. Thus forj = pus , 


ur 
) * 0 (mod p). 
We can summarize this discussion in 


Lemma 6: The number of t which satisfy (2) ts exactly the number of t for 
which 


Dir) = 2sw. 
By a previous remark, this is just the number of ¢ such that 
Ditr) = sw. 


This problem is equivalent to finding the number of u, 1 S$ u < p* — 1, 
such that 


D(u) = sw and u=0 (modr). (5) 
We state the result in 


Lemma 7: The number of integers u which satisfy (5) ts (? a ') , 


Proof: Write u in the form 


s—1 


s—l s—1 
U= yD ap + p° > b;p* + p° 2 cxp 


a A + pB+ pC, 
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where 
OS A,B,C Sr=p —-1. 
Then 
Ue Ah BANC As Qa Bae Gp? = 1) C 
and so we have 
u = 0 (mod r) 
if and only if 
A+B+C =0(modr). 
Since u > 0, then by Lemma 5, 
D(A + B+C) 2 sw. 
But 
D(A+B+4+C) Ss D(A) + D(B) + DC) = Du) = sw 
by the corollary to Lemma 3. Hence, we must have 
D(A +B+C) = sw = D(A) + D(B) 4+ D(C). 
This implies that 
a,+b + ¢; 


and consequently 


IIA 


w. +20 e t 


A+B+CSsr. 
However, the requirement that r divides u implies 

A+B+C=r, 

so the only possibility left is 
a, +b; +c = w, 7=0,1,°--,s—1. 

Since the number of ways (cf. Ref. 4, 6.6) of obtaining w as the ordered 
sum of three nonnegative integers is « : *) = 4 - ) then the 
total number of choices for A, B, and C (and hence for uw) is just 


G z ') . This completes the proof of Lemma 7. 


By combining the preceding lemmas, Theorem 2 is proved. 
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V. CODING THEORY 


It has been shown' that the minimum distance of the dual code of the 
cyclic code R-6(x) is at least p* + 2. It is now easy to show that the 
minimum distance of R-6(2) itself is p* + 1. 

Since R-6(x) contains 6(x@), p* + 1 is an upper bound for its minimum 
distance; it suffices to show that it is also a lower bound. 

By Theorems 1 and 2, ¢' is a zero of 6(z) if D(tr) = sw (this is, of 
course, only a sufficient condition). By Lemma 4, the p* — 1 numbers 

= 1,2, ---,p* — 1 have the property that D(tr) = sw; clearly ¢ = p* 
also has this property. Thus there are at least p* consecutive powers of 
¢ which are zeros of 6(x). By the usual proof of the Bose-Chaudhuri 
bound* (See Ref. 5, Section 9.1) the minimum distance of R-6(x) is at 
least p> + 1. 

Theorem 2’ is a summary of known results about difference-set cyclic 
codes. 


Theorem 2: Let di,d2,+-+,d: be a Singer difference-set modulo n, 
wheren = p* + p* +1. Set 


l 
6(x) = >> ao, 
i=1 
Let R be the ring of polynomials modulo x” — 1 over GF (p). Then R-6(x) 
; . {pt 1yVy 5.3 
1s u cyclic code of dimension 9 + 1, and minimum distance 


p +i. 

It has been shown that for every Singer difference-set modulo n, 
there exists a set of integers ¢ such that ¢* is a zero of the difference-set 
polynomial. The set of such ¢ is the same for every difference set, but 
this of course does not mean that every 6(x) has the same zeros in com- 
mon with x” — 1. The difference set is constructed by means of a primi- 
tive nrth root of unity v; v determines the choice of £, and a different 
choice may or may not lead to a different set of zeros for 6(x). 


APPENDIX A 


Example 


Take p = 2,s = 2,n = 2° +2741 = 21, nr = 2° — 1 = 63. The 
polynomial x° + x + 1 is an irreducible factor of x + 1 over GF (2) 


* The proof applies although R-6(z) is not necessarily a BCH code. 
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[see Ref. 6, p. 809, polynomial fio]. In this case, w is a cube root of unity 
and the above polynomial factors over GF (4) into 


(® +a + we + w)(2* + a? + we + 0’). 


We take a zero of the first polynomial for y, and for purposes of calcula- 
tion it is convenient to express it as 


1 1 0 
v=lw 01 
w 0 0 


It is readily checked that the characteristic equation of this matrix is 
v +2? + wa +o. A table of the relevant powers of v follows. 


1 1 ) is 1 ' wo & ;] 
p= |w 1 w 0 vale 1 wv 
a , wo w . 


0 1 0] o OL: ol 


0 0 


12 


ope vy =f{1l io 0 
ne wow w 1 


Take d, = 3, de = 
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a 
ae ae eee Beet 12 


GV 


ov + y= lt w 


Hence, 3, 6, 7, 12, 14 is a difference-set modulo 21. In this case, r = 
2? — 1 = 8, and the appropriate values of ¢ are 5, 10, 20, 19, 17, 13; 
9, 18, 15. (tr = 15, 30, 60 etc.) It is readily checked that each tr has a 
digit sum (to base 2) of 2s = 4. 


APPENDIX B 


Let 6(z) = ao + aw + +++ + anuv”. The ideal R-6(x) consists 
of all linear combinations over GF(p) of the n polynomials 26 (2x) 
(mod (2” — 1)),7 = 0,1, ---,m — 1. Its dimension is therefore the 
rank over GF (p) of the matrix 








Qo Q1 Go ***  An-1 
Qn-1 Ao A Se L An—2 
A= 
a1 a2 a3 S's ao | 
Let a1, a2, *** , an be the n zeros of x” — 1 over GF (p); they are all 
distinct since p does not divide n. Let A be the matrix 
fl 1 ree JT] 
OQ Qe “5 An 
A= lar as’ On 
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Then 
det A = [J (a; — a;) ¥ 0, 


i<jgsn 


and the rank of A is the same as the rank of AA. Now, 


[8 (a1) 0 (a2) “+* 0 (ay) ] 
a6 (a1) 226 (a2) -++ nO (an) 
AA = 
la:”"@ (a1) ae” (a2) an” 6 (an) J 
Suppose the a; are arranged so that 0(a;) 0,7 = 1, --: , t, and 6(a;) =0 
7=t+1,---,n. The last » — ¢ columns of AA contain only zeros, 


so that the rank of AA is S ¢. The ¢ by ¢ matrix in the upper left hand 
corner of AA is 








(0 (an) 6 (a2) “++ O(a) 
a8 (ay) 26 (a2) “++ a6 (az) 
lar 0(o1) an T8(a2) +++ ae’ 70 (cx) | 


and the determinant of this is 


(a1) -0(a2) +++ (ar) TI (ai — aj) ¥ 0. 


i<j<t 


Thus, the rank of AA (hence, the dimension of R-6(2)) is exactly t. 
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Simultaneously Orthogonal Expansion 
of Two Stationary Gaussian 
Processes — Examples 


By T. T. KADOTA 


(Manuscript received April 20, 1966) 


This paper presents two examples of the simultaneously orthogonal 
expansion of the sample functions of a pair of stationary Gaussian proc- 
esses. The pair of Gaussian processes are specified by zero means and co- 
variances exp (—a|s — t|), exp (—B|s — t|) in Example 1 and by 
1—|s—t|/8T, exp (— |s —t|/T) in Example 2. The expansion takes 
the form of a trigonometric series where the coefficients are mutually in- 
dependent Gaussian variables for both processes, and the series converges, 
both with probability one for every t and in the stochastic mean uniformly 
in t, for both processes. This type of expansion is an extension of the Karhu- 
nen-Loéve expansion to the case of a pair of processes, and no concrete 
example has been given previously. 

The general theory of the orthogonal expansions is briefly reviewed in 
Section I, while concrete results for the two examples are tabulated in Sec- 
tion II with a brief outline of the method of derivation. The complete deriva- 
tion, which constitutes the principal part of this paper, is presented in full 
detail in Appendices. 


I. GENERAL THEORY 


Orthogonal expansion of Gaussian processes has been used extensively 
for both theoretical investigation and application in communication en- 
gineering. In the case of a single process, the expansion is a modified ver- 
sion of the Karhunen-Loéve expansion.’” Specifically, if x(t), —T < 
t S T, is the sample function of a Gaussian process with zero mean and 
a continuous covariance R(s,t), —T S s,t S T, then a(t) can be ex- 
panded in terms of the (orthonormalized) eigenfunctions f;, , k = 0, 1, 2, 


1071 
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-, of Ras follows:* 


¢(t)-= 2 f(x) fz(t), ae. [P], 


E(x) = (2,fx), a.e. [P],t 


where P is the Gaussian measure induced by the process with zcro mean 
and the covariance RP. 

This expansion has two desirable properties: (7) for every measurable 
set specified by the sample function 2 (¢), there is an equivalent mcasura- 
ble set specified by the coefficients, {&}, and (7) {&} are mutually in- 
dependent Gaussian variables with zero means and variances equal to 
the eigenvalues of 2. Thus, many problems concerning the sample func- 
tion can often be reduced to equivalent problems concerning the coeffi- 
cients alone, and they in turn can be decomposed into a collection of 
effectively ‘one-dimensional problems’’. 

In the case of two Gaussian processes, the sample functions can be 
expanded relative to a single set of functions such that their coefficients 
are mutually independent with respect to the two finite dimensional dis- 
tributions.{ Such “simultaneously orthogonal’? expansions have often 
been used to prove the equivalence-singularity dichotomy of two Gaus- 
sian measures.’ The particular expansion theorem used here is due to 
Pitcher.” It goes as follows: Let P, and P2 be the probability measures 
induced by two Gaussian processes with zero means and continuous, 
positive-definite covariances R,(s,t) and Re(s,t), —T S s,t S T.§ If 
Ri 'R2Rr° is densely defined and bounded on £ and its extension to the 


* R denotes both the covariance and the integral operator generated by it, 
namely, 


T 
(RN) = / R(s,f(s)ds, fe La, 


=F 


where £2 is the space of square-integrable functions on [—T,,7]. 

t Without loss of generality, the process under consideration is assumed to be 
separable and measurable. (f,g) denotes the usual scalar product of two elements 
fandgin &2. 

t Instead of regarding ‘‘two Gaussian processes’”’ as two one-parameter families 
of random variables, we consider a single one-parameter family of measurable 
functions x, —7’ S$ ¢ S T, with two probability measures P; and P2 . 

§ We assume that P; and P: are extended to ® and complete on ®p, and @p, , 
where & is the minimal o-field with respect to which x; is measurable for every 
te [—T,T]. Since Ryi(s,t) and Re(s,t) are both continuous, we consider only the 
separable and measurable version of {%: , —7’ S$ ¢ S$ T} without loss of generality, 
where the separability is with respect to 3(P1 + Pe) while the measurability is 
with respect to @ipite. X @ and @ is the Lebesgue field of the subsets of [— 7,7]. 
Note that such a version is also separable with respect to both P; and Pz and meas- 
urable with respect to @p, X @ and Bp, X @. 
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whole of £2 has a set of eigenfunctions which spans £2, then 


a(t) = lim. » n(x) (Ri! ion) (0), . (Pi X w, Po X wl, 
m(&) = Lim. (2, Ri ges), [P,,Pal, 
joo 
where gz , & = 0, 1, 2, --- , are the orthonormalized eigenfunctions of the 
extension of Ri RR , and yp is the Lebesgue measure defined on the 
subsets of [—7',7], andg:; ,7 = 0,1, 2, --- , area sequence of £.-functions 


in the domain of R™ that converges strongly to yg, for each k, namely, 


vie D(Rr), lim |l@ — gs] =0, & =0,1,2,-- 
joo 


As in the case of a single process, this expansion also has two desirable 
properties: 

(i) for every measurable set A specified by x(t), there exists another 
measurable set A’ specified by {n,} such that 


P(A AA’) = 0= P(AAN),t 
(it) Ex{nun3} = On3, Holmen} = dey, =k, 7 =. 0, 1, 2, 


where 2; is the eigenvalue of the extension of Rr *R2Ry° corresponding 
to g, . As seen from the definition and the property (27), 7, k = 0, 1, 2, 

, are, with respect to both P; and P2 , mutually independent Gaussian 
variables with zero means, and their variances are all unity with respect 
to Py and A, with respect to P». 

Unfortunately, the above theorem is not a suitable method of actually 
obtaining the simultaneous expansion for a given pair of covariances 
Ri(s,t) and Re(s,t). As the result of definig the expansion coefficients 
n, and the expanding functions Ry'g, in terms of g , k = 0,1, --- , one 
must first of all solve the homogeneous equation involving the extension 
of Ry *Roky?. Yet, there is no standard method of solution available for 
this type of equation, since Ri Ry? is not, in general, a simple operator 
as R; and R, are. This may partly account for the fact that no concrete 
example for the simultaneous expansion has been given previously. In 
the next section and Appendices, we give two examples to illustrate an 
indirect method of obtaining g, first and then calculating m and Rigr . 


* The measurability is with respect to @ip,4P. - 
+ A denotes symmetric difference, namely, AAA’ = (A— A’) U (A’— A). 
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II. EXAMPLES 


The two examples we consider here are stationary Gaussian proc- 
esses with zero means and the pair of covariances 


Ri(s,t) = exp (—als — t]), R2(st) = exp (—6| 8s — t]) 


in Example 1, and 


—t = 
Ri(s,t) = 1 —- ee, R2(s,t) = exp (- eat) 


in Example 2 


The method we employ to obtain the expansions may be outlined as 
follows: First, we prove that Ri ?R2Ry* is densely defined and bounded, 
by showing that RR, * is bounded. Next, we consider solutions of the 
homogeneous equation 


Ro, = VApRwy - 


If y is a square-integrable solution with a real number A; , then Riv is 
seen to be an eigenfunction of Ry Rs. Thus, the function Ry’g, in the 
desired expansion is simply R:y, .* Unfortunately, there are no such solu- 
tions in Example 1, and there are only half of what is needed in Example 
2. However, suppose we consider ‘formal solutions” of the homogeneous 
equation and expand them relative to the set of eigenfunctions of 1, 
which forms an orthonormal basis of £2. Let y;,; be the sum of the first 
7 terms of such an expansion. Then, it turns out that the normalized 
version of {R1'W;;}; is the desired sequence {y;;} used for defining 7 . 
That is, we show that (7) the normalized version of {R1y;;}; forms a 
Cauchy sequence and its limit in the mean is an eigenfunction of the ex- 
tension of Ry *R:R1’ with d, as the corresponding eigenvalue for each 
k, (iz) the collection of all such limits forms an orthonormal basis of 
£2, hence they are the only eigenfunctions of the extension. Thus, the 
desired expansion is obtained simply by calculating Rien ,k = 0, 1, 2, 


Finally, that the expansion series in both examples converge both 
e. [P1, P| for every ¢ and in the mean [P1, P.] uniformly in 1, is de- 
ic as follows: We first observe that the ¢-functions of the series are 
uniformly bounded in 72 and ¢, and the sum of the variances of the coeffi- 
cients is finite with respect to both P; and P: . Thus, by virtue of mutual 
independence of the coefficients, the partial sum of the series, denoted by 


* The expansion in terms of Ry; is suggested in Ref. 6 without the connection 
with ROR Ry. 
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Xn (é), converges both a.e. [P; , Pe] for every ¢ and in the mean [P,, P»] 
uniformly in ¢ to some Gaussian variable %(¢), Ai{z(¢)} = 0 = Epf{#(t)}. 
Now, since z,(¢) converges to x(t) in the mean [Pi X p, Po X yl, 
Eif{an(s)an(t)} and Kof{an(s)an(t)} converge in the mean [un X yp] to 
Ri(s,t) and Re(s,t) which are continuous. Hence, they converge uni- 
formly to Ri (s,é) and F2(s,t), respectively, which implies that 


EY{%(s)#(t)} = Ri(s,t) and Lpf{%(s)%(t)} = Re(s,t). 


That is, {z(¢), —7 < ¢ S T} is a Gaussian process with zero mean and 
covariances F;(s,t) and R2(s,t) corresponding to P; and P» , respectively. 
Hence, %(t) = x(t), a.e. [Pi , Ps] for every t. Thus, it follows that z, (¢) 
converges to x(t) both a.e. [Pi , Pe] for every t and in the mean [P,, P| 
uniformly in t. 

The results are tabulated in the following summary. In both examples, 
the orthogonal expansions of the sample function take the form of 
trigonometric series, which asymptotically behave like harmonic series 
for large indices. The coefficients are mutually independent Gaussian 
variables with zero means, and their variances are explicitly given, 
together with the asymptotic values for large indices. In addition, we 
include for future reference the eigenvalues and the (orthonormalized) 
eigenfunctions of the extension of R:-*R2R1? to the whole of £2 , though 
they are not of the primary interest here. 


III. SUMMARY 
3.1 Hxample 1 
Ri(st) = exp (—a]s —¢]), R2(s,t) 


= exp (—8|s — ¢]), a>Bp>d0 
a(t) = >° [n.(a) cos 6,¢ + 4:(a) sin 6:4], a.e. [P1, Pal, 
i=0 


where 6,’s and 6,’s are positive solutions of” 
(a + B)0; tan 0:7 = a8 — 6; 
—(a + 8)6; ctn 6.7 = o8 — 67, 


and n:, 4;,7 = 0,1, 2, --- , are mutually independent Gaussian varia- 
bles with zero means and variances given by 


*@,’s and 6,’s are indexed in the ascending order. 
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Ex{ni} = 2a/(a° + 0;)7 (02), E{qi} = 2a/(o* + 67)r (6), 
Eo{ni} = 26/(8 + 0: )r(8:), -Ea{q’} = 26/(6° + 6;')r (6:), 
where 
2 (a + B)op 
TOS P+ RE e+ BR aR 
For large 2, 
3 1\7 T 
od Ee aie 
2aT T 
By {nd} ~~ 7——, Bs (a WS, 
(: a 5) a UT 
2 
26T 26T 


t,, 2 Qo 4 2 m~N —.,. 
i, {ni } (: i ) ; ) Ee {fi } a 


The extension of Ri *R2R1° has eigenvalues 


Bo + 6; Bo + 6; 


Noi =F BTL Oe? Ait = — ae + 62’ 





and orthonormalized eigenfunctions 








2a a + 0; ; : 2 
ga(t) = cos #:T' lim. >> y(o;, 0:) cos ao;T' cos ao;yt, 
n>o 7=0 





a+ BL 7(6:) 
9 + 6, 
gun(t) = 5 | | sin 6,7 Lim. p3 v(¢;,6;) sin o¢;T' sin a6, 


where 


Pe 
y(o,0) = (1 + a’)? /|r + ae aa | (ao — 6), 
and o; and é; are positive solutions of* 
o; tanac;T = 1, —¢;ctn ac,;T = 1. 


*o,’s and *,’s are indexed in the ascending order. 
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3.2 Hxample 2 





Ri(st) = 1 — biead , R2(s,t) = exp (- —). 


a(t) = 2) n(x) cos Ot + 4:(x) sin Ot], ae. [P;, Pal 
7=0 


where 9,’s are positive solutions of” 
6;T tan 6,7 = 1, 


and 7;, 4:,2 = 0,1, 2, --- , are mutually independent Gaussian varia- 
bles with zero means and variances given by 


2 a2 1+ 0;T° 
Ey {ni } = Ey {Ai } = 6272(2 + 027?) ’ 
A2 2 


Ba{ne} = Bale} = soaps 


For large 2, 


Ex{ne} aid 


0:~ it : 
- _ —_—_—- 
‘ fhe Pa? 
ar 1 . 
The extension of Ri *R2f1 * has eigenvalues 


9977" 


Ae = Agi = T+ 027?’ 


and orthonormalized eigenfunctions 


ge a al fan 
gai (t) —— (7 itm) cos 6, 
~ (-1)'G+4)0 


A NG Te BIE gy $ 1 T 
j=0 077" — (7 + 4)? x? sin (7 + 3) ii t. 


poizi(t) = 2y0:( 7’) ].i.m. 
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APPENDIX A 


Example 1 


Ri(s,t) = exp (—a|s — t|), 


—T< t 
Ri(s,t) = exp (—B|s — t| ), smi 


IIA 


7: a>p>Qd0. 


A.1 Eigenvalues and [igenfunctions of Ri and Re 


Let uw, and f,, & = 0, 1, 2, --- , be the eigenvalues and the corre- 
sponding orthonormalized eigenfunctions of 2: . Then, 


2 2 
a a 7 ——————————— ; ,-— : 1, 2, # Toe 1 


fai(t) = Cos coat | (1 + nae 


2ac; 
in 2a6,7'\} o 
forts (t) = sin ast | (1 — net) ) 
2a6; 
where o; and @; are positive solutions of 
o; tanac:T' = I, —¢;,ctnaé;T = 1, (3) 


respectively, indexed in ascending order.” 
Similarly, the eigenvalues and eigenfunctions of Rz, denoted by » 
and g; , are given by 


Vy = Shine He Mit = ea ae (4) 
“BF pt)? BO + BA)? 
goi(t) = cos cot [ (2 + Sin ho) , 
pi 
in 268:7\' I 
guest) = sin pea / (7 — 22602) 
289: 
where p; and #; are positive solutions of 
Pi tan Bo:T = 1, —pi ctn Bp.T = ]. (6) 


A.2 Boundedness of Ro'Ry? 


Since {fz} forms an orthonormal basis of £,[—7,7], we only have to 
show that || Re’Rr “f; || is uniformly bounded relative to the index k. 





* See Ref. 7, pp. 99-101. 
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Namely, we must show existence of a constant c, 0 << ¢ < ©, independ- 
ent of k such that 


(Ren hl = 2 — Cea) << 
1 Mk 
Consider even k's, and put k = 27,7 = 0, 1, 2, --- . Observe 
(for, gr) = 9, I: odd. (7) 


Hence, we shall consider only even l’s. Note 


T 2 
( i COS aa,t COS Bpjt it) 
IT 


sin 2a0;T sin 26p;T' , 
T eee aA Nace A ah Bead 
( = 2a; ) (7 ey 2Bp: ) 


(fei 923) = j = 0, 1,2, ---, 
T 

{ cos ag,t cos Bp;t dt 

—T 


cos ao; cos Bp;T 
aa; my Bp;” 


2(ac; tan ac;T' — Bp; tan Bp,T) (8) 


cos aa;l' cos Bp;T 
aa? — Bp? 
where (3) and (6) are used for the last equality, and 
(1 + ¢7) cos’ ao,T = o?, (1 + pj) cos’ Bp;T = p;, (9) 
which also follow from (8) and (6). Thus, 


2(a — B) 


4® (a — g)? cos® BojT 


SL Ge aR ae ae a(Bp;aor 
2ac; 
where 
2 
cos 6T 
ey py Sn eT 





26 
Also note that 

aoe - ] 1 
Bp? (ara? — Bp)? (aa? — B%p;*)? — a’a.®8*p;? 


1 1 1 
+ 2a8o,3 e cP Bp; a acy — =) 
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First, through direct calculation with the use of (5) and (8), 
T 2 
2 2 mW a(Bp;) 
pp COs aot go;(t) a = 4(a = B) COS aol (Goi — By! ; 


and from the fact that {g,} forms an orthonormal basis of £2 , 


00 T 2 
a | cos act go;(t) a| 
7=0 7 


T 
i cos’ act dt 
Lo 


7 sin 2ac;T 
mes 2ac0; 
Thus, 
| oo 48 (a — B)” cos” Bp; . 
ye __a(B8e;) Bw (11) 
7=0 (7 Ee sin =) (ao? -— B'p7)? ™ Cos? ago!’ 
2ac; 
Secondly, it follows from (3) and (6) that 
- pe 4 SI BaGT - 5 1 
ok Qac, a3 E + aT(1 + =| Pes 
in 26p;T me) 
sin 28p; 
T +——_ > fT, 
2Bp; 
and 
T 7 Tv : 
ao; > (Z,), Bp; > (5.4) ? J = f. 2, (13) 
Thus, a(8p;) < 1/7. Hence, 
Be B)2 eat Rn. 
> 4- (a — B)* cos? Bp;T a(Bp;) 
= ( sin Zar oo 7B" p; 
T + —— 
2ac; (14) 


Fhe rl ; 


aa" 


lol 


Thirdly, let hi(z) be a function of the complex variable z defined by 


z 


iu(2) = ztan 27 — B- 


Then, h1(z) satisfies the condition of a theorem on expansion in rational 
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functions,” and has poles 8p; and the residues a(8p;), 7 = 0, 1, 2, --> 
Hence, according to the theorem, 








= 1 1 ac; 
. ——— ee es = h i = ig : 1 
2, a(Bp;) (— + Bp; ee as) ey a—B oe 
where (3) is used for the last equality. Thus, 
B 
ae. BD BN esas 3 
oe 
pa . sin 2a0;T 2a%o2 \ao; + Bp; ao; — Bp; 
T 2ac; (16) 
28(a — B) 
= oo eT 


where (12) is also used. 

Therefore, upon combination of (11), (14), and (16), together with 
(7), we conclude that for even k’s >> (v1/ux) (fx » gr)” is bounded by the 
sum of the right-hand sides of (11), (14), and (16), which is obviously 
independent of k. 

For odd k’s, we can arrive at the same conclusion by following the 
similar steps. 


A.3 Formal Solutions of Roy = Rw 


The formal solutions of the homogeneous integral equation 


[. exp (—6|s — t|)¥x(s) ds = mf exp (—a|s — ¢])yi(s) ds 











are 
Ba +O Ba + 6; a = 
A2i a B+ 62’ Agit = ap + 62’ = 0, ay ) (17) 
eee ee we ot — T) + ae + PY], 
nal (18) 
Vey Sees eh t) 3C ea), 
a+ 86 
where 6; and 6; are positive solutions of 
(a + 8)6; tan 6:7 = oB — 6;, 
(19) 


—(a + B)6; ctn 6.7 = a8 — 6;, 
* See Ref. 8, p. 134. 
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respectively, and they are indexed in ascending order. Namely, if 6; and 


6:,7 = 0, 1, 2, --- , are solutions of (19), then the following equalities 
hold for every 1: 


T 
i] exp (—6|s — ¢|) cos 6,8 ds 
_T 


~ {ex p [—6(T —t)] + exp [—6(T + #)}} 











aaa 
size ate exp (—a|s — t|) cos 6:8 ds 
cos 6;T’ 
as ae {exp [—a(7 — t)] + exp [—al(T + on], 


T (20) 
[ exp (—B|s — t]) sin 6;s ds 











+ Sn OF fox p [-—A(T — t)] — exp [—A(T + #)]} 
- bate ue exp (—a|s — t|) sin 6, ds 
=e sine {exp [—a(T — t)] — exp [—a(T + on |. 


The above assertion can be verified through direct calculation. 
A.A Eigenvalues and Engenfunctions of Ri *RoRi ? 


A.A1 {Reve} 1 form Cauchy sequences 


Let Yr, k,l = 0, 1, 2, --- , be the lth partial sum of the series ob- 
tained by formally expanding y, of (18) relative to {f,} of (2), the eigen- 
functions of R,. Namely, for 7 = 0, 1, 2, --- 


Woi,on(t) = Woienti(t), 


n 


= > ha cos 0:8 fo;(s) ds + 25 


7=0 





SOF jul) | ful) (21) 


Woitrenti(t) = Wersten+e(t) 


= > i sin 6;s fojai(s) ds 


49 sin 6;T 





AE pura T) | felt) 
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Then, {Ri'Wiet 1 forms a Cauchy sequence for every k. 
Proof: It suffices to show that for every k 
oe || Bryan |? < 0. 


Irom (1) and (2) and through the use of (19), 


|| Ravesen ||’ = > te: cos 6,8 fo;(s) ds 


cos 6,7 2 
a 2 tat) | a ory 


2a°(1 + a; ) 





4a 2 
1 te iT ee 
(a + By cos’ 6 ¥ a(ao;) (i? — aa) 
Note also that 
HG Noah te, a + 6,” -i( 1 ze 1 
(02 — a®a;*)? (02 — a’a;*)? 6; 6; + 20; 0; — ag; ; 


Next, with the aid of (2), (3), and (19), we find 


: thes _ 4(a" + 6°)’ cos’ 1’ —_a(aa;) 
fe nos Ot fo;(t) at| = — (atpe (0; 92 — arg)?" 


Also observe that 














ff? a a sin 20,7' 

Ss il cos 6,t fo;(t) a | = i cos 6 dt = T + a, 

7=0 —T —T 26; 
Thus, 

ale +67) 2a sin 26,7 
wer ad?  alao;) Be to, = 8 T+ i: ; 
Next, following the procedure for obtaining (15), 
a(ag;) 1 1 
(a wtp ‘at 5, 0; (otra) 
4a cos’ 6,7 








~ a+ Bab + Oe? 


where (19) is also used. Hence, 


. +) 8 2a sin 26:7 , 2 cos’ 6,7 2ar(6;) 
lim [| Rr'pera || = a alr + et 0 + 200 8) _ eo}? 
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where 
(a + B)aB 
64 + (a? + B?) 6" + ap? 
and (19) is used for the second equality. 
By following the same steps, we obtain 


: 1 Qar(8;) 
] Ryo: Pg — 
ue I| Ra'Ports.r || + be 


4) = T+ (22) 





Thus, the assertion is proved. 
A.4.2 Orthornormality of {¢} 
Define gm, k, m = 0, 1, 2, --: , by 


(lim | Roi. I") 3 Ri'oi,on ) 


P2i,2n = 2i,2n41 
i 2\-1 pd (23) 
CU, = Petite = (lim || RaWorss,r |] ) Ry Potty - 
—>0O 
Define ¢ by 


got = Lim. geen goiga = LAM. Goisienqa. (24) 
NP 


Neo 
Then, {g;} is a sequence of orthonormal functions. 


Proof: Normality is obvious. To prove orthogonality, let us first write 
gx explicitly. 





# 207(1 2)]} cos ao;T 
go(t) = lim. b; >> ee oe 08 oi _ cos ao;t, 
n> 7=0 [7 j 2.2 92 
(7 o 2ac; Jie i i) (25) 
oo pe [207(1 + 6,?)]? sin a6 ,T 
grad) = link). 7 3 a I ee, 
Sa Set (a _ sin 2a6;T (0242 — 6,2) 
206; : ‘ 
where 
2 ay : : 2 Ah2) TP cin A. 
ee ES + 6; ] cos 6; ee |e zi 6; | sin 67 (26) 
7(63) at 6 7(6:) at+B 


First, note 

(voi, G2mu1) = 0, t,m=0,1,2,°-- 
Secondly, 
2a'(1 + a; ) 


(02 — a0?) (On? — Boj)’ 


(G2i,Gom ) = bibm Z a(aa;) 
j= 
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and 





2Qa°(1 + o;’) 1 E a nf 1 1 ) 


(07 — a?¢;7) (Om? — aa;*) On? — 62 6, 6; + ac; 0;— a0; 


_ ao 4 =) 
Om Om + ac; | Om — aaj) 


Again, following the same procedure for obtaining (15), 
bibm (< + 0; 0; 
Om” = 6; 6; 6; tan 6,7 pee 5 2 


_ t+ Om Am ) =, 





(yo: om) — 


where (19) is used for the second equality. 
By following the same steps, we also obtain 
(eit, Gem) = 0. 


A.4.3 {gx} forms an orthonormal basis of £2 
Since {g;} is a sequence of orthonormal functions and {f7} is an ortho- 
normal basis of £2 , it suffices to show that for every 1 = 0, 1, 2,---, 


X (fi, 9%) = 1: 


First, note that (f:,¢,) vanishes unless / and k have the same parity. 
Secondly, from (2) and (25), 


2 1 
Dd, (fos ) aj)” a 


sin 2a0;T 

(a+ (7 + eee) 
cos’ 6,1 4a’a;(a + 6;’) 

i=0 (a + B)r(8;) (aa? — 0;*)? * 


and also note 


Aa’a? (a + 6;") _ 8 2 | 1 1 | 
(ao? — 07)?  * EE? (ac; + 0;)? " (ao; — 6;)? 


2 2 
a (1 — a;) 1 1 
nF ao; ; (—- a 6; a ag, — :) , 
Now, consider a function of the complex variable defined by 


Zz 


fake) = (a + B)z tan 27 — oB + 2° 
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h2(z) satisfies the condition of the previously quoted theorem and has 
poles +6; and the residues 





2 
cos 6;T' : 
soe eet SNOT) 8 hie: 
(a+ B)r()’ 7 
Also, 
d 1 1 — oe sin 2a0;T 
gy ete) lasietes _ a(1 + o;) E +. o; = (a ss B) (7 + 2a0; )| © 
Thus, according to the theorem, 
a(l—o67) GQ cos’ 6,7 ( 1 1 ) 
ad; 7=0 (a + B)r(0;) ado; + 0; acy — 6; 
a’ (1 = a; ) 1 — ee 
lene a aa ipo 


where (3) is used for the second equality. Also, through the use of a 
modified version of the theorem,” 


i] 


; % cos’ 6,7 1 : 
C1409 ary eater t Gar | 


= —a(1+a/) © hale) |-ac; = (a + B) 


sin 2a0;T Tonge 
(r+ 2ac; )- ts. 


Hence, upon combination of these two results, 


cos” 6;T Adlai (a + 6;') ashy iG) (7 fs sin se) 


1=0 (a F B)r(0;) (a?o;? _- 07)? 2ac; 


* The modified version: 
Let f(z) be the function satisfying the condition of the theorem (Ref. 8, p. 134), 
having poles a, and their residues b, . Then, 


Dn 


d 
Tag = wh Get) lew 


This is proved by noting that 


1 f) _ a bn 
[ dz = — S(2) lene + » 


Qri = (z = x)? an — x)? : 





and the left-hand side vanishes as m —> ©, where Ci, is the contour defined in 
Ref. 8. 
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Thus, 


I 
= 
te 
bo 


D (fee, e25)” = 1, t 
7=0 

By following similar steps, we obtain 
ys (fostr » Gaz41)” = |, os O51, 2228 
7=0 


and the assertion 1s proved. 
A.4.4 Closed form-expressions of Ry’¢x 


d yy) ; 
Ry'go(t) = aa cos 6,t, 


a= 0,1,2,---. (27) 





F 2 ssn 
Rveun(t) = E ic a | sin 64, 


Proof: From (25) and (1), 


\ es HO =O 1 
—Ry'go(t) = lim Mia > 6; (t) ( : ae 5x) 


noo 8; 7=0 6; + ac; 0; — ao; 





a 1 


z Nn 


. a tbrat eh Li : 
—Ryexs(t) = lim 7 2, &(¢) G + ad; e i) 


A 
n>0 Qi 7=0 5 AGG 





where b; and 6; are given by (26) and 


cos ag;l’ cos ac;t 
T + (sin 2a0;T'/2ac;)’ 


sin a¢;T7' sin aé jt 


6) = (in QadjT/28) 


e;(t) = 


In order to sum the series, consider 


2 Cos at 
zsin 27 — acoszl'- 


hs(z) = 


Observe that h3(z) satisfies the condition of the previously quoted the- 
orem, and has poles -kac; and the residues c;(t), 7 = 0, 1, 2, -- 
Thus, with the use of the theorem, 





} _ bya’ foe a'(a + B)b: 
Ry poi(t) = 6, h3(6;) = (a? + 6) cos 6,1 Cit, 


* The residues of h3(z) are shown to be c;(¢) through direct calculation with 
the use of (3). 
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where (19) is used for the second equality. Similarly, 


a (a + Bo 
(a + 62) sin 
Then, substitution of (26) into the above gives e ie 

AA.5 dy, and oy are eigenvalues and eigenfunctions of Ry RR” 

Az, and g& , k = 0,1, 2,~-- , are the cigenvalues and the corresponding 
orthonormalized eigenfunctions of the extension of Ri ¢R2R1° to the 
whole of £2. 


=P gilt) = ; sin é; l. 


Proof: It suffices to show that for every k 
Netti ee = lcm. RiRY Gees 


where gpm, m = 0, 1, 2, --- , are defined by (23), namely, gem is the 
mth partial sum of the series obtained by expanding g, relative to 


{fi}. 


Through direct calculation, 


T 
| exp (—6|s — #|) cos 6:8 ds 
— 7 





cos 6;T ae a _ 26 
ce +3 {exp [—A8(T — t)] + exp [—8(7 + t)]} = a 02 8 it. 
Thus, from (17) and (27), 
rl b; 
Nos (Pr'yoe) (1) = eal Le exp (—6|s — t]|) cos @s ds 
+ sos on fexp [—6(7' — t)] + exp [—A(T + on}. 


On the other hand, from (23) and (21), 
(RoRr ‘p28,0n) (E) = (ReRy *go:,041) (t) 


(a + B)b; < 


= 90) cos 0.7 2, (Refo;)(t) Ea cos 0:8 fo;(s) ds 


6;T 
49 cos 





OF pAT) |. 


But, since 

T n T 
i exp (—8|s — t|) cos 6;s ds = lim. >> (Rofo;) (t) [ cos 6,8 f2;(s) ds, 
—T n>0o 7=0 — 


we only have to show 
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exp [—B(7 — 8] + exp [—B(1 + #)] = 2 lim 2 foi( 1) Re fos) (0), 
L¢., 
RAT t) + R.(-T yt) = Lim, Ze [fi(T) + fil —T)] (Refi) (2). 
But this is certainly implied by 
Re (s,t) = Pz (fx, Re fidfe(s)fr(t), —T = St < dip (28) 
where 
T 
Re (st) =f Rals) Raut) du 


To prove (28), we first note that the series on the right converges to 
R2’(s,t) in the mean. In addition, 


ZOlLar, 
as seen from (2) and (12). Hence, it suffices to show that 


|e Rath) | < @, 


which is implied, through the Schwarz inequality, by 


© ll Bafs I < 2, 


Hence, we have shown that 


Aolti'g2; = lim Roki “gei,m z= 0,1, 2, °-: 
Mao 


Through the same argument, (28) implies 


1 P sik 
Aeqiltrgoiqs = lim Ielty “Gaisism - 
mero 


APPENDIX B 


Example 2 
PA sae t | 


ne (- etl) 


R,(s,t) 


I 
i 








Ro(s,t) 
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B.1 Eigenvalues and Eigenfunctions of Ri and Ry 


The eigenvalues and the orthonormalized eigenfunctions of R; are 








1 We 
i= ; Ww = ss eo 0 ee ee ee 29 
‘ ; l\7 
sn|? +s} 

COS Ot 2/7 

fai(t) = ( sin on) ) foita(t) — T ) (30) 
20; 
where @;,7 = 0, 1, 2, --- , are positive solutions of 

6;:T tan 6,7 = 1, (31) 


indexed in ascending order. Similarly, the eigenvalues and eigenfunctions 
of I. are 


2T pak 
m= Tage w= Pa gape (32) 
sin 6,t 
i(t) = Jor(t), wt) = —————__—, 
gai(t) = fost) grits(t) (1 7 aoe any (33) 
26; 
where 6; ,7 = 0, 1, 2, --- , are positive solutions of 
—6,T ctn 6:7 = (84) 
B.2 Boundedness of RiRy* 
From (29), (32), and (383), 
a 2 20°" : 
| Re’Ri “fo: ||" = TE <2, ¢=0,1,2,-:-. 
Since 
(feiss , 923) = 0, j = 9, LD. Ping 
we have, through (29), (80), (82), and (33), 
ae 2677" = 4T cos’ 6,T (4 + 4)*x° 
|| Re'Ry “fers ||? = Do se ae 
7=0 | +6;T T sin 20,;T [6;T = (4 + 3)"r'] 


and also note 
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(4 a 1)?7" _ 677° 
[°7" — (¢ + 4)’'P (677? — (i + 4)*o'P 
(35) 
ee 
Ce 
Now 
=. 4T cos’ 6;T 677" = 2 
ee OD (frit 2541)” = 1, 
2, 7 _ sin 26;T [6,7° — (¢ + 4)*af > Set Uar (36) 
26; 
-. 26:7? ~—-‘T cos’ 6;T 1 
j=0 ] + 677" rT sin 26,7 67T° — (¢ +3)’ 
26; 
) A 2rn2 2A 
cp eee a ee 
=0 (1+ 6;T°) 7 — sin 26,;T 





26; 
where the first inequality follows from the Schwarz inequality and (36) 
while the second follows from (34).* Hence, || Ro'Ri “fers ||’ is also 
bounded by a constant independent of 7. 
Thus, by using the argument in A.2, we conclude that ReR,° is 
bounded. 


B.3 Formal Solutions of Riv = Roy 


Unlike Example 1, the even solutions of 


[ exp (-18z Is i!) Wi(s) ds = Xx ic Q-' da al) Wn(s) ds (37) 


are bonafide functions while the odd remain formal. They are 


20°T" 
1 + 627?’ 








Aer = Aoi = (38) 


Yo(t) = cos Ot, 
Yoigi (t) = sin 6¢ + T sin 6;T'[6 (t —_ qT) = 5(é + T)). 
* It follows from (384) that 


sin 26,;T 1 
—S = = 1+ —_ T, 
2 r( +: ro, > 


which corresponds to (12). 


(39) 


T— 
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Again, the precise meaning of the odd solutions is that if 6; , 7 = 0, 1, 2, 
- , are positive solutions of (31) then 


T 
[ exp (- lel sin 6;,s ds + T sin 6;T 
T T 


foo(-2)-oo(-EE)] 


2077" ic ls —¢t| . . 
“TP Ly Li og sin 6,8 ds + tsin 6;T 


for every 7. Again, the above assertions can be verified through direct 
calculation. 





B.4 Eigenvalues and Eigenfunctions of Ri *RoRy° 


B.4.1 {Rivoiss,}1 form Cauchy sequences* 
Define, for each + = 0, 1, 2, --- , 


Worgtangi(t) = Poigsjeng2(t) 
2 Tf. sin 0,8 fojii(s) ds (41) 


+ 27° sin 6;T fuss?) | foji(t). 


7 


1 : 
Then, {f1’o:41,2}2 forms a Cauchy sequence for every 7. 


Proof: From (29) and (30) and through the use of (81) and (35) 


n Tv 
| Ri verercones (|? = » | f sin 6;8 fojsi(s) ds 


7=0 


T 
+ 2T sin 6,7 fuss?) GE 





J 5) 7 
4 cos 6;7 < 0°T? ees 
= cy Pr ae eee | 2 
0:7  F=0 | arr" = (; i x) | i = (; a 5) 


= 40278 26,7 t : ] i 
Dy. ree 1 2 2 = [ sin’6,t dt = T — oe = (42) 
0} pq _[(; , 1) 2 TT io 


* Note there is no need for considering such sequences for the even solutions 
Woi’8, since they are already £2-functions. 
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In order to sum the second term, observe that the function of complex 
variable tan z satisfies the condition of the theorem repeatedly used, 
and has poles (j + 3)z, 7 = 0, +1, +2, ---, and the residues —1. 
Hence, using the theorem, 


= 1 _ tan 6;T 
: 2 => ——. 
7=0 g 2p? _ (; ai. 5) a 20;T (43) 


- Thus, combining the two results, 


] sin a) 


lim | Rivscaseas |’ = aT (7 + it hae (44) 


Hence, through the use of the argument in A.4.1, the assertion is proved. 


B.4.2 Orthonormality of {yx} 
Define ¢g;, , k = 0, 1, 2, --- , by 
pu = fu, G24. = lim P2i+1,1 » (45) 
where zt = 0, 1, 2, --- , and 


putie(t) = (im I| Rapossse "ye Ribpoisa,e. 


Then, {g,} is a sequence of orthonormal functions. 
Proof: Normality is self-evident. Note, from (30) and (41), 
(y2: 5 g2m) = bin, (ya: 5 gom41) = 0, m=0,1,2,°°-, 


2 
(i +3) Zz 
2 m2 . T\" << 272 . 1\ 2 
al —\Its5 Tv Om LT —\I +5 T 


and 


(Qoiy1 Pam) = AT foi( T ) fom ( T) 


Ms 


7 


ll 
° 


_ 2fei(T ) fom(T) > 0 
Ba Oee Te Ae a 5) 
0; Om 
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Thus, from (43) and (31), 


6:7 tan 0:7 — OmT tan OT _ 


(goigs ’ om+1) = 2foi( T ) fom( T ) bmn2 — 6,2 


0 


B.4.3 {¢} forms an orthonormal basts of £2 


First, note from (80) and (45), 
Dy (Jai sen) = De far fas)” = 1 t= 0, £2, 9 os 
= = 
Next, 


[oe] foe) 
> (fos 1, gu) = 2, (fossa paizs)” 
= £ 


. Ns 
7 S 4T cos’o;T (: aE 5) - 
7 7=0 + sin 20;T 2 2 os 1 ; 2 ; 
P x2 5, jar (1 +3 7 


roa L, os(é +5) Fonls) as] 


= 1. 





Thus, using the argument in A.4.8, the assertion is proved. 


B.4.4 Closed form-expressions of Ri'ox 


(Rigi) (t) = di; cos 64, (Ri'gei4s) (t) = di sin Ot, (46) 


where 


1 ee ei 
«= ap (+ ream) 


Proof: The even part of (46) follows immediately from the even parts 
of (45) and (29). Now, from the odd parts of (45) and (29),” 


2(—1)’d,6;T cos 6;T' sin (i +- s) 7 t 


1\2 
62T? — (i Big 5) ar? 
2 
* Note, from (84) that 


sin 26;T I 
T + — = 1+ ———_ _]. 
= 20; am ‘ *. 1+ m) 


= (Rigor) (t) = lim. 2 
n?H 7= 
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In order to sum the series, observe that a function of complex variable 
sin 2(t/T')/cos z satisfies the condition of the theorem repeatedly used, 
and has poles (7 + 3)a,j7 = 0, 41, +2, --- , and the residues 


—(=1)’sin (j + 4) (a/T)t. 


Thus, according to the theorem, 


2(—1)’ sin (; +3) Re sen 
—— f... {\e ODP agen 
‘ 627? — (3 ale 5) oe 6:1 cos 6,7 


Hence, substitution of the above yields the odd part of (46). 


Ms 


q 


B.4.5 d, and yg, are eigenvalues and eigenfunctions of Ri ‘R2Ry* 
The assertion of A.4.5 holds. 


Proof: That d2; and ge; , 7 = 0,1, 2, --- , are eigenvalues and eigenfunc- 
tions of the extension of Ry R2Ry ° is easily seen from (29), (32), (33), 
(38), and (45).* 

Tor the odd part, i.e., Aec41 and gei41 , we need to show that 


Mergers = Lim. Rokr gees « (47) 
mPa 


Through direct calculation, 


= [s—tl\ . 
| exp ( — ; ) sin @;s ds 
Lip 7 
+ T sin 6;T | exp (- re) — exp (- ui = ‘| 


on, 28 
ee 








sin 0,t. 
Hence, from (37) and (46), 


T 
kona Rion) (t) = dT” | f exp (- eel) sin 6;s ds 
—T 


; Lot T+t 
+ T sin 6,7 | exp ( a) — exp (- rT : 
On the other hand, from (45) and (41), 


* Note ga: is an eigenfunction of Rr?R2Ry? itself, without extension to the 
whole of £2. 
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(Retires tise) C= (RoR *yor41,:n42) (t) 
T 


d62T" » (Rofoj+1) (t) | : sin 6;8 fojti(s) ds 
= = 


+ 2T sin 6;T ful) 7 


But, since 


Tv n 
| exp (- Is 4) sin 0;s ds = Lim. >> (Rofoj41) (t) 


—T n>eo 7=0 


T 
mi sin 6:8 fosii(s) ds, 
—T 


we only have to show 


exp (- tr) _ exp (- P * ) = 2 lim Y fursalT) (Refeses)(t), 





which is implied by (28). 


Then, by following the argument after (28), (47) is proved.* 
The second assertion of A.4.5 is valid in this case also, since {gx} of 
this example forms an orthonormal basis. 
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Ideal MOS Curves for Silicon 


By A. GOETZBERGER 
(Manuscript received April 22, 1966) 


Ideal curves of MOS capacity and surface potential are computed for 
silicon with oxide thickness and doping as a parameter. High-frequency 
and low-frequency capacity curves are presented for the doping ranges 
between 1 X 10% and 1 X 10" cm and SiOz thickness between 100 and 
12000 A. Additional curves gwe flaitband capacitance, minimum capaci- 
tance and voltage of the minimum capacitance in the same ranges.* 


Measurement of MOS (Metal-Oxide-Semiconductor) capacity vs 
voltage is a convenient and widely used technique for evaluation of the 
properties of semiconductor-insulator interfaces.!?3 Most MOS-type 
measurements require comparison of the experimentally measured curve 
with the ideal curve. This is usually time consuming because the 
ideal curve is represented by rather complicated functions and 
has to be calculated for each value of silicon doping and oxide thickness 
separately. 

The purpose of this work is to facilitate such evaluations by providing 
a collection of curves embracing all the practically important ranges. 

Three sets of curves are furnished. 

(2) Plots of differential capacity vs voltage with thickness as a param- 
eter and P-doping density N4 varying from plot to plot. The 
capacity is normalized with respect to the oxide capacity Cox . 
The dashed lines are the high-frequency branch of the curves. 

(iz) A plot of surface potential y, corresponding to each of the pre- 
ceding curves vs applied voltage V. For definition of the surface 
potential see below. 

(212) A set of curves giving a survey of pertinent results of this calcu- 

lation. 

(a) Flatband capacity Cys (defined as capacity for y, = 0) 
vs oxide thickness with doping density as parameter. 

(b) The minimum capacitance Cnin/Cox plotted in the same 
manner. 


* Additional curves covering intermediate doping ranges of 2 X 10!4 cem™3, 5 X 
10", etc., are available on request. 
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(c) Voltage at which the minimum capacitance occurs. This is 
the voltage difference between the point of flatband capacity 
and minimum capacity. 

The entire calculation was done on the IBM 7094 computer. The low- 
frequency curves were computed for room temperature using the well- 
known! *;5.6 relations between capacitance, surface potential, and applied 
voltage. Pertinent constants used were: dielectric permittivity of sili- 
con; és: = 1.06 X 10-” F/em, dielectric permittivity of SiOs ; eo. = 
3.4 X 10-8 F/em. The calculation was carried out for p-type silicon and 
$102 insulator, but the results can be adapted to n-type silicon and 
insulators other than SiO2 . The conversion to n-type is achieved simply 
by changing the sign of the voltage axis, the conversion to other insula- 
tors requires scaling of the oxide thickness with the ratio of the dielectric 
constants of SiO» and other insulator 


€ 
de = dq — 
Ep 


where d. = thickness to be used in these curves, d; = actual thickness, 
Ep = dielectric permittivity of the new dielectric, «, = 34 xX 10-8 
F/cm. Surface potential y, as used here is defined as the amount of 
band bending from the bulk to the interface in volts. y, is positive, when 
the bands are bent downwards from the flatband position. It should be 
noted that the origin of y, is the flatband potential and that its distance 
from the band edges varies with doping. 

The low-frequency curves were calculated under the assumption that 
minority carriers contribute fully to the capacity. For calculations of the 
high-frequency capacity, an approximation developed by Sah’ was used. 
In this approximation, the space charge region is divided into three parts 
and their contribution to the capacity separately computed. The high- 
frequency inversion range was connected with the low-frequency curve 
by a smooth line. 

The curves were computed for doping densities from 1 X 10" to 
5 X 107 cm and oxide thicknesses from 100 to 12000 A. 

For the higher doping ranges, the computation was terminated at an 
oxide thickness giving a minimum capacitance of about 0.9 of the oxide 
capacitance. In some of the curves at lower doping overlapping ranges 
of oxide thickness were plotted in separate graphs to prevent the curves 
from coming too close to each other. For instance, one plot contains 
oxide thicknesses 600 A, 1000 A, etc., the other 800 A, 1200 A, etc. 
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Fig. 1— MOS capacity vs voltage. Oxide thickness 100-700 A. (Nun = 10X 
10" cm) 
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Fig. 2 — Surface potential vs voltage. Oxide thickness 100-700 A. (Na = 10X 
10" em7) 
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Fig. 3 — MOS capacity vs voltage. Oxide thickness 600-1800 A. (N4 = 10 
10% em-3) 
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Fig. 4 — Surface potential vs voltage. Oxide thickness 600-1800 A. (N44 =1.0X 
1014 cm73) 
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Fig. 5 — MOS capacity vs voltage. Oxide thickness 800-2000. A (Na = 10 
10 em73) 
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Fig. 6 — Surface potential vs voltage. Oxide thickness 800-2000 A. (Na = 
1.0 * 10! cm?) 
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; Fig. vg MOS capacity vs voltage. Oxide thickness 2000-5000 A. (V4 = 1.0 X 
Qu em-3 
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Fig. 8 — Surface potential vs voltage. Oxide thickness 2000-5000 A. (N4 = 
1.0 X 10" cm“) 
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Fig. 9 — MOS capacity vs voltage. Oxide thickness 2500-5500 A. (V4 = 1.0 X 
104 cm~’) 
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Fig. 10 — Surface potential vs voltage. Oxide thickness 2500-5500 A. (N4 = 
1.0 X 10! em-) 
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Fig. 11 — MOS capacity vs voltage. Oxide thickness 6000-12,000 A. (V4 = 
1.0 < 10 em-) 
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Fig. 12 — Surface potential vs voltage. Oxide thickness 6000-12,000 A. (Na = 
1.0 X 10" cm-3) 
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Fig. 13 — MOS capacity vs voltage. Oxide thickness 100-700 A. (V4 = 10X 
10!5 em73) 
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Fig. 14 — Surface potential vs voltage. Oxide thickness 100-700 A. (Na = 
1.0 X 10!5 cm) 
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Fig. 15 — MOS capacity vs voltage. Oxide thickness 600-1800 A. (V4 = 1.0 X 
1015 em~8) 
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Fig. 16 — Surface potential vs voltage. Oxide thickness 600-1800 A. (Na = 
1.0  10!5 em-’) 
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; Fig. = -— MOS capacity vs voltage. Oxide thickness 800-2000 A. (V4 = 1.0 X 
015 cm 
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Fig. 18 — Surface potential vs voltage. Oxide thickness 800-2000 A. (V4 = 
1.0 X 10!5 cm-) 
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res — MOS capacity vs voltage. Oxide thickness 2500-4000 A. (V4 = 1.0 X 
Hy em3 














is IN VOLTS 























-2.0 -1.5 —-1.0 5 0.5 1.0 15 2.0 2.5 3.0 3.5 4.0 
V IN VOLTS 


Fig. 20 — Surface potential vs voltage. Oxide thickness 2500-4000 A. (Na = 
1.0 X 10'5 em7’) 
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Fig. 21 — MOS capacity vs voltage. Oxide thickness 4500-6000 A. (Na = 1.0X 
10! em7?) 
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Fig. 22 — Surface potential vs voltage. Oxide thickness 4500-6000 A. (N4 = 
1.0 X 1015 em-3) 
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Fig. 23 — MOS capacity vs voltage. Oxide thickness 6000-12,000 A. (Na = 
1.0 & 10!5 em7=3) 
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Fig. 24 — Surface potential vs voltage. Oxide thickness 6000-12,000 A. (Na = 
1.0 X 1015 em7’) 
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Fig. 25 — MOS capacity vs voltage. Oxide thickness 100-400 A. (V4 = 1.0 X 
1016 em) 
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Fig. 26 — Surface potential vs voltage. Oxide thickness 100-400 A. (V4 = 
1.0 X 10° em-3) 
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Fig. 27 — MOS capacity vs voltage. Oxide thickness 600-1200 A. (V4 = 1.0 X 
10'6 em7%) 
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Fig. 28 — Surface potential vs voltage. Oxide thickness 600-1200 A. (V4 = 
1.0 X 10'6 em-3) 
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Fig. 29-~ MOS eapacity vs voltage. Oxide thickness 1400-2000 A. (Na = 10X 
10'6 em) 
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Fig. 30 — Surface potential vs voltage. Oxide thickness 1400-2000 A. (Na = 
1.0 X 10!6 em7) 


IDEAL MOS CURVES 1115 








0.92 








0.84 


C/Cox 








0.80 











0.76 





0.72 

















0.68 
-2 








V IN VOLTS 


Fig. 31 — MOS capacity vs voltage. Oxide thickness 2500-4000 A. (V4 =1.0X 
10'® em~) 
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Fig. 32 — Surface potential vs voltage. Oxide thickness 2500-4000 A. (Na = 
1.0 X 10!* em-’) 
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Fig. 33 — MOS capacity vs voltage. Oxide thickness 4500-6000 A. (VN, =1.0X 
10'6 em73) 
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F Fig. 34 — Surface potential vs voltage. Oxide thickness 4500-6000 A. (Na = 
1.0 < 10'® em7) 
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Fig. 35 — MOS capacity vs voltage. Oxide thickness 100-400 A. (V4 = 1.0 X 
101? em73) 
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Fig. 36 — Surface potential vs voltage. Oxide thickness 100-400 A. (Na = 
1.0 X 10"? em-) 
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Fig. 37 — MOS eapacity vs voltage. Oxide thickness 600-1200 A. (V4 = 1.0 X 
107 em~) 
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Fig. 38 — Surface potential vs voltage. Oxide thickness 600-1200 A. (Na = 
1.0 <X 10!” em-) 
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Fig. 39 — MOS capacity vs voltage. Oxide thickness 1400-2000 A. (V4 = 1.0 X 
1017 em73) 
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Fig. 40 — Surface potential vs voltage. Oxide thickness 1400-2000 A. (N4 = 
1.0 X 10'7 em73) 
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Fig. 41 — Flatband capacity vs oxide thickness I. 
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Fig. 42 — Flatband capacity vs oxide thickness IT. 
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Fig. 43 — Minimum capacity vs oxide thickness. Doping density as parameter 
1X 10'*-5 X 1015 em-3. 
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Fig. 44 — Minimum capacity vs oxide thickness. Doping density as parameter 
LX 10'*-5 X 107 em=. 
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Fig. 45 — Voltage of cap. minimum vs oxide thickness. Doping density a 
parameter. 
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Fig. 46 — Voltage of cap. minimum vs oxide thickness. Doping density as 
parameter. 


Signal-to-Noise and Idle Channel 
Performance of Differential Pulse Code 
Modulation Systems — Particular 
Applications to Voice Signals 


By R. A. McDONALD 
(Manuscript received April 25, 1966) 


Analysis leading to a figure of merit for differential pulse code modulation 
(DPCM) systems with linear feedback networks is presented. It is shown 
that the figure of merit can be optimized. Simple DPCM has a 6-dB ad- 
vantage in signal/quantizing noise ratio over pulse code modulation (PCA) 
for speech. Optimization yields at most 4 dB more. Computer simulation of 
the system using actual speech sanvples leads to data supporting the figure 
of merit as a useful measure of performance for DPCM systems with four 
digits or more. The simulation also provides data on the error spectrum as a 
function of quantizer loading and on the probability density of the quantizer 
input as a function of loading. Performance of the optimum system as a 
function of increasing feedback network complexity is also shown. 

Idle channel performance of a particular system is analyzed, indicating 
the presence of inband oscillations in many cases. The best quantizer bias 
jrom the point of view of zdle channel performance is found. The level of 
idle channel noise in DPCM 1s shown to be approximately equivalent to 
that in PCM. 


I. INTRODUCTION 


Digital techniques for transmitting analog signals such as voice, 
television, or facsimile have been known for a long time, and technology 
has reached the point where some of these methods are commercially 
feasible. Since cost is a critical factor in determining applicability of 
these systems, there has been from the beginning an attempt to improve 
the efficiency of analog-to-digital conversion by reducing the bit rate 
required for a given accuracy of reproduction. One of the principal 
methods involves removing inherent signal redundancy through the use 


1123 


1124 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1966 


of feedback around the quantizer, and has led to a wide variety 
of schemes which may all be classed as differential systems. The origins 
of differential pulse code modulation (DPCM) stem from patents by 
the N. V. Phillips Company in 1951! and by C. C. Cutler in 1952.2? The 
ideas also appear in several papers of about that time.*-45 Since that 
time, considerable research and development work has been reported, 
and one has only to look at our reference list, which is certainly not 
complete, to be convinced that the problems have been examined at 
great length. 

The work to be reported here is the result of a fairly extensive investi- 
gation of the potential advantages and pitfalls of voice transmission by 
practical DPCM systems and by alternatives which are essentially 
variations on the basic theme of PCM or DPCM. The problems are 
handled analytically as far as is possible. But rather than dilute the result 
by using an over-simplified model for the input signal, a computer simula- 
tion is used to advantage in more than one place. Optimum as well as 
simple suboptimum systems are considered. 

Some of the analysis reported here is applicable to systems other than 
ones for voice transmission, but the one application is considered 
throughout since it provided the motivation for the entire project. A 
similar project was carried out independently by J. B. O’Neal® of Bell 
Telephone Laboratories, but with special consideration given to televi- 
sion signals. The special considerations introduced by the speech signal 
include the need to investigate performance for a wide range of input 
signal levels and a need to investigate idle channel performance. 

There is considerable overlap with the work of Nitadori.? The work in 
Sections III, IV, and V was influenced heavily by his original work, but 
is based on broader assumptions. The validity of our assumptions is 
checked by means of the computer simulation described in Section VI. 
This simulation may also be construed as a check on the assumptions 
used by Nitadori and others. Our optimum linear network is developed 
from a viewpoint different from that of Nitadori. 

The analytical results are also essentially parallel to those of Oliver’ 
although his work is not directly applicable to the differential systems 
investigated here. 


Il. SYSTEM DESCRIPTION 


The pulse code modulation (PCM) system shown in Fig. 1 will serve 
as the basis of comparison for all the others. The input and output shown 
are sequences of samples, since all the systems under consideration will 
require sampling. In the PCM system, one high-speed quantizer and 
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Fig. 1— Basic PCM system. 


coder can be shared among many channels by time division multiplexing 
the pulses representing the analog samples. There will be greater diffi- 
culty multiplexing the inputs to the differential systems, thereby intro- 
ducing higher costs associated with the terminal portion of the system. 
It is this fact which controls the economics of the system. If, under an 
equiperformance criterion, the differential system requires fewer digits 
per unit time on the transmission portion of the system, but requires a 
more expensive terminal, there will be a net advantage whenever the 
repeatered line costs are a large enough portion of the total costs (i.e., 
long haul systems). It will be assumed throughout the paper that the 
controlling source of impairment is the quantization noise introduced by 
the quantizer with a finite number of steps of finite size. The overload 
noise is hence included here. The measure of performance will be the 
ratio of the mean squared signal to mean squared noise, or in the case of 
the idle channel, the mean squared noise alone. 

The basic DPCM system which we shall consider is shown in I’ig. 2. 
Without going into the details of operation of the system at this point, 
we note that the diagram actually represents a wide class of systems, 
different members of which are obtained with different prediction net- 
works. In actual fact, we shall be restricted in our investigations to 
linear prediction networks, but this still leaves a rather broad class of 
systems. 

The configuration of Fig. 2 bears a resemblance to several somewhat 
different systems described in the literature. We refer particularly to the 
work of Kimme,? imme and IXuo,!° and of Spang and Schultheiss."' 
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Fig. 2— Basic DPCM system. 
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These systems involve quantization noise feedback rather than predic- 
tive feedback, and are thought of as shaping the spectrum of the noise 
rather than removing signal redundancy. It has been shown by Kimme® 
that there is an equivalence between a noise feedback system with predis- 
tortion and post-distortion filters and a DPCM system with predistor- 
tion and post-distortion filters. That is, given one configuration, there is 
a transformation which yields transfer functions for the blocks of the 
other configuration such that the performances are identical. However, 
we have found the predictive feedback point of view useful in its own 
right. 


Ill. SIGNAL-TO-NOISE RATIO IMPROVEMENT 


Notation needed for the algebraic analysis of DPCM appears in Fig. 2. 
A stochastic model is assumed for the speech samples, 7; , with a sym- 
metrical zero-mean distribution not dependent on 2. The primed quan- 
tities on the receiving end differ from the unprimed quantities only 
when the repeatered line introduces digital errors. For the most part, we 
shall ignore digital errors, and deal only with the unprimed quantities. 

Virst, the quantizing error is defined as 


Ce; = & — Ye (1) 


Note that in (1) and in the equations to follow, the index 7, which denotes 
the time order of the samples, decreases to indicate samples further in 
the past. Unless otherwise stated, it is meant that the equations hold 
for all integers 7. 

The other fundamental relationships indicated by the block diagram 
are 


eo Vi Te (2) 
Hf aN Ee te) (3) 
fi = Da hyti-i, (4) 


where the coefficients h; are characteristics of the prediction filter. Note 
that in the last equation only the samples of the output of the assumed 
linear filter are indicated. This filter may have a continuous time re- 
sponse so long as the samples conform to (4). The absence of an ho term 
in (4) implies the presence of some delay around the loop. 

Substitution of (2) and (3) into (1) gives 


€é; =X; — &;. (5) 
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Comparison of (1) and (5) indicates a very important point about 
DPCM. The quantizing error samples, as defined in (1) are identical to 
the error samples for the overall system, in the absence of digital trans- 
mission errors. When quantizing is relatively fine, the successive quantiz- 
ing error samples are statistically uncorrelated to a good approximation. 
Therefore, the signal reconstructed from the error samples has a power 
spectral density which is flat to a good approximation, as in PCM. 
According to (5), these same statements also hold for the overall system. 
There is no contradiction here, because e; in £; is not simply the response 
of a linear network to the error e; in y; . In fact, the feedback introduces 
error terms in 2; , and these combine with the quantizing error to produce 
the total error in 4; . The flat scectrum does not hold for coarse quantiza- 
tion nor when the probability of overload is high. In these cases, neither 
the PCM nor the DPCM error spectrum would be flat, in general, nor 
would the two spectra be the same. The spectrum of error which results 
is discussed in detail later, and is determined by a computer simulation 
in Section VI. 

In order to determine properties of the quantizing error, e;, it is 
necessary to determine properties of the quantizer input, z; . Substitution 
of (4) and (5) into (2) yield an equation for 2; 


a= Yi d hjvi-j + > hei; . (6) 
I= I= 


It is obvious that even if the last term in (6) were neglected, the statisti- 
cal properties of z;, and in particular the probability density, depend on 
joint statistics of the input and past samples of the input. In the case of 
voice transmission, there exists empirical data on the probability den- 
sity” and spectrum’ of speech signals, but a good model for even the 
joint statistics of a pair of samples is not known to the author. 

At this point, let us discuss the properties of e; which it is desired to 
find. The spectral properties of e; are already known, as mentioned 
earlier, provided relatively fine quantizing with low overload probability 
nolds. The probability density of e; is not considered important, since 
there is no evidence to indicate a strong dependence of subjective quality 
on this property. But the most often needed property is the variance of 
e;. A well-known””® expression for the error variance of an L step 
quantizer is in terms of the probabilities of the various quantizer steps, 
pz;, and the step sizes, A;. 


L AZ 
Efe} | pron = Dy Dz — , (7) 
7=1 12 
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To emphasize the dependence of the step probabilities on the input 
variable statistics, we use the input variable as a subscript in addition 
to the step index. This expression is approximate since among other 
things overload is neglected, but it is most accurate for fine quantizing 
and low probability of overload. We are interested in comparing this 
with the quantizing noise in a PCM system with input x; and step sizes 
A; . With the same type of notation the expression is 


. L Aue 
Ete; } | pom = 2) Psi Fa: (8) 
7=1 


Although the ratio of the two quantities given by (7) and (8) is a compli- 
cated function of the probability densities of z and x, and also of the 
choice of step sizes, a rough understanding of what determines this ratio 
can be found in simpler terms. Suppose the step sizes A’; are chosen to 
have a fixed ratio with the step sizes A; ; that ratio being the same as the 
ratio of the rms values of the two inputs. Then, to the extent that the 
probabilities p,; and p,; are the same, the variances of the errors will be 
in the same ratio as the variances of x and z. The probabilities in question 
will be the same if the probability densities of the normalized variables 
a/V72 and z/ V2 are the same. 

Whereas an analytic expression for the probability density of z cannot 
be derived without a model for the joint statistics of x, empirical evi- 
dence will be given later to show a strong similarity between the prob- 
ability density of normalized speech, and that for normalized z in one 
important case. It is hence natural to use as a figure of merit the ratio of 
2 to 2%, which we shall refer to as SNR IMPROVEMENT. 


v0 {xz} 
Liz} ° 
We now return to (6). Under the assumption of vanishingly small 


statistical correlation among the error samples, and between the error and 
the input signals, the variance of z; may be written 


SNR IMPROVEMENT = 





(9) 


ive) 


oo 2 
E{2;} = By(a, = > has) -|- E{e;} D hj’. (10) 
= 7=1 
It may be noted that the last term in (10) becomes a negligible fraction 
of the total for high enough signal-to-noise ratios. We note also that the 
figure of merit depends on the ability to predict x; with a linear sum of 
past samples. In fact, we can optimize the figure of merit by choosing the 
h; to be the optimum linear prediction coefficients in the sense of mini- 
mum mean square error (see Papoulis, Ref. 17). On the other hand, it 
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should be noted that the optimum coefficients provide a best match to a 
particular set of signal properties. But speech signal statistics are not 
constant from speaker to speaker, nor even for one speaker. Therefore, 
it is best to investigate as well some suboptimal systems with parameters 
not dependent on signal properties. We also note in passing, that adap- 
tively controlled prediction coefficients might provide an even better 
solution to the problem. We do not treat the adaptive case in this paper. 


IV. SIMPLE, NONOPTIMAL, DPCM 


Historically, most of the investigations of predictive feedback systems 
have not included general feedback networks. One of the most common 
systems has an integrator or accumulator in the feedback path. That is, 


hk =1 
hj=0O j#Fl. (11) 
It is easy to show that in this case, 
f= Dues (12) 
and 
2=U —-Mtaitert. (13) 
Then, by (10), 
Elze} = Elxz} (201 — m)] + Ble} (14) 
where 
Ei} x21} 
OE 
Neglecting the last term in (14), the figure of merit becomes 
SNR IMPROVEMENT & 5. (15) 


Hence, the figure of merit is greater than unity whenever the normalized 
adjacent sample correlation of the input signal exceeds 0.5. This result is 
identical to results obtained by Oliver,® Nitadori,’ and O’Neal,’ although 
derived under different assumptions. Empirical work to demonstrate the 
validity of (15) will be shown in a later section. 

This scheme has the advantage that there are no parameters dependent 
on signal statistics. On the other hand, performance does depend on 
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signal statistics. If p, drops below 0.5, the performance is actually worse 
than PCM. Another disadvantage to this system is that digital channel 
errors introduce a permanent change in the de level of 4; . In fact, the de 
level of 4,’ will, in the presence of random channel errors, execute an 
unrestricted random walk until the output saturates. Further discussion 
of this problem will be found in the next section. In spite of these diffi- 
culties, this is the scheme most widcly investigated in the literature. In 
fact, the computer simulation to be reported later will use this system. 


V. OPTIMUM LINEAR FEEDBACK NETWORK 


As was mentioned previously, the linear feedback coefficients h; may 
be optimized in order to minimize the variance of z;, thus maximizing 
the figure of merit given by (9). Note that our assumptions have been 
such as to eliminate the effect of the quantizer nonlinearity from the 
expressions, and that the solutions given here are optimum only for the 
cases where our assumptions hold. The problem is somewhat simplified by 
assuming that the sums in (10) terminate at 7 = N. Since the mutual 
information between samples usually becomes zero when the samples are 
remote from each other, the coefficients h; will approach zero for large j. 
Therefore, the truncation at 7 = N does not limit the applicability of the 
result in cases of interest. Differentiation of the right side of (10) with 
respect to the variables 4; , and setting the resulting expressions equal to 
zero gives the following set of linear algebraic equations. 


1 
pi = (1 + ai + hop: + hsp2 + +++ + Awpn-r 


p2 = hipr + (1 =| t) he + hspi + +++ + hypy—e (16) 


1 
PN Iapy-a + hopy—2 + hspy—3 ftoeee Ht (1 -+- z) hy, 


where 
K = E{x?} /EXe;} 


is the signal-to-noise ratio, assumed constant, and p; = E{axw,_;}/E{a;?}. 
With the exception of the coefficients on the principal diagonal, this is 
identical to the equations given by Papoulis’’ for determining the opti- 
mum linear prediction coefficients. By dividing each equation through by 
the coefficient on the principal diagonal, the equations are again nor- 
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malized, with new correlation coefficients. The problem is of course the 
classical Wiener-IXolmogorov prediction problem in discrete form. 

Tor small N, the algebraic expressions for the solutions are easily 
obtained. Tor larger N, a computer solution is more suitable. These 
solutions may then be put back into the original expression for the error. 
It is easy to show’ that the minimum variance of z; may always be 
written in the form: 


E{z2} |min = Efxe} E = Yh (6 /( a 2))I. (17) 


Hence, the optimum figure of merit becomes 


1 


Spe ; ie > a (5 /(2 +z) (18) 


It is clear that with fixed sampling rate the minimum error will either 
remain constant or be monotonically reduced for progressively larger N. 
That is, each sample further in the past can only add information on 
which to base a prediction. However, since speech is not perfectly pre- 
dictable from past samples, it is to be expected that the minimum vari- 
ance will approach a finite, nonzero, limit as N becomes large. A numeri- 
cal example showing this relationship, with data from actual speech 
signals, is given later. 

The stability of the closed loop which is present in the DPCM trans- 
mission terminal has not been studied in detail. However, the following 
reasoning clarifies the issue to some extent. Suppose the quantizer 
granularity is neglected, z.e., assume y; = z;. Then, using (2), (3), and 
(4), it is easy to show that 





SNR IMPROVEMENT 


y= £; 
foo) 

yi = 2: = ti — Dy hyee;. 
ist 


Then the system is stable under a simple criterion requiring the sum of 
the magnitudes of the h,’s to be finite, and possibly under some weaker 
criteria. This simple case depends on a precisely unity gain amplifier in 
place of the quantizer. If the gain should remain linear but drift from 
unity, there exists a forward path from f; to 4; . If the gain of this path is 
sufficient, instability could result. If the granular characteristic of the 
quantizer is considered, it can be seen that oscillations are possible, in 
the manner of the bang-bang servo. Some of these cases are investigated 
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in Section VII. In the cases studied there, the oscillation is bounded, and 
this means stability in an operational sense. 

Because the N = 1 case results in considerable simplification, it will be 
examined a little further. For this case, 


n=m/(1+¢) (19) 


and the figure of merit becomes 


1 
SNR IMPROVEMENT SS a 
1-[a/G+e)f 
nal ig K 
For large K this is approximately 
1 


SNR IMPROVEMENT 


~w 








a Loa (21) 

Comparison of (21) and (15) shows a slight advantage for the opti- 
mum case over the nonoptimum case, both using one past sample for 
prediction. Note also that the optimum case always holds an advantage 
over PCM whereas the nonoptimum case holds an advantage only when 
pi > 0.5. However, the optimum case requires a parameter adjusted to 
the assumed signal statistic p:, whereas the nonoptimum case has no 
such parameters. 

It should be noted that when p; > 0, the prediction network for the 
optimum case with N = 1 is merely an attenuation with delay. The 
overall response of the network from y; to f; is that of a “leaky” integra- 
tor with delay. This system is one that has been proposed as a means of 
reducing the problem created by digital channel errors. The effects of 
digital transmission errors decay exponentially. Hence, the system out- 
put does not execute an unrestricted random walk. 


VI. COMPUTER SIMULATION — AN EXAMPLE 


Because an adequate mathematical model for speech is not available, 
it was necessary to resort to simulation of the system on the computer, 
using as input digitized sampled speech, recorded on computer tape. 
The tape was kindly provided by J. F. Kaiser of Bell Telephone Labora- 
tories. Measuring devices for probability density, variance, and auto- 
correlation were also simulated on the computer. Knowledge of the 
autocorrelation function alone is sufficient for evaluation of the figure of 
merit in each case. But statistics of the derived random variable z are 
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useful in checking the assumptions leading to our results. Autocorrela- 
tion of the quantizing error is also useful in checking our earlier assertions 
concerning error spectrum. 

Tirst, consider the properties of the signal contained on the input tape. 
The original digitization for computer purposes is linear quantizing with 
11 digits. The quantizing error thereby incurred is ignored in further 
work because quantization introduced in the simulations is much more 
coarse than this. Table I(a) indicates the normalized autocorrelation of 
the samples. Note that sampling is at the rate of 9.6 kHz. The spec- 
trum, constructed from this data using a hanning window,® is shown 
in Fig. 3(a) on linear coordinates. 

Shown for comparison purposes in Fig. 3(b) is a spectrum constructed 
as follows. Speech spectra from Dunn and White! for men and women 
are averaged, and the sum multiplied by the attenuation characteristic 
of a local loop with a 500 telephone set.!® Although the spectra in Figs. 
3(a) and (b) are not precisely the same, the general characteristics are 
sufficiently close to ascertain the worth of the particular sample. It should 
be noted that the sample represents only 5 seconds of speech in real time, 
and cannot be expected to provide a representative average statistic 
with high precision. However, there is close enough agreement with 
published statistics to make our point. 

Fig. 4 shows the probability density function of the speech sam- 
ples normalized relative to their RMS value. This was drawn using 
data obtained by computer processing the input tape. The curve is 
shown only for positive values of the samples and actually represents an 
average of both halves of the data. Shown for purposes of comparison 
are the Laplacian distribution, often used as a speech model,!® and the 
Gamma distribution proposed by Richards.?° The presence of intersyl- 
lable and interword quiet time and the presence of low level unvoiced 














TaBLE I — AuTOCORRELATION COEFFICIENTS — py 
N (a) (b) 
9.6-kHz Samples 8.0-kHz Samples 

0 1.0000 1.0000 
1 0.9035 0.8644 
2 0.6683 0.5570 
3 0.3875 0.2274 
4 0.1311 —0.0297 
5 —0.0632 —0.1939 
6 —0.1939 — 0.2788 
7 —0.2695 — 0.3030 
8 —0.3003 — 0.2823 
9 — 0.2980 — 0.2208 

10 — 0.2659 — 0.1330 
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Trig. 3— Speech spectra; (a) data used in simulation; (b) published data. 
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Fig. 4— Normalized probability density of speech. Symmetrical average of 
“+” and “—” data. 
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consonant sounds account for the sharp spike at the origin. The general 
shape conforms reasonably well to data presented by Davenport.” 

However, the main reason for using the speech samples is that the 
second-order statistics are supposed to be representative. It is necessary 
to take this on faith by extrapolating the favorable comparisons of the 
first-order statistics and the spectra. 

The theory presented in Section IV predicts that the figure of merit for 
the simple, nonoptimal, DPCM is given by (15). Using p1 from Table 
I(a), we get 


10 logis (SNR IMPROVEMENT|:. uz) = 7.14 dB. (22) 


Under the assumptions developed in Section III, this is the amount by 
which the overall signal-to-noise ratio will be improved in comparison 
to PCM, with the same quantizer, comparably loaded. 

In Fig. 5(a) are shown curves, determined by the simulation, of signal- 
to-noise ratio in dB versus input level for PCM and DPCM. The quan- 
tizers are 4 digit in each case, and have nonuniform steps conforming to 
the » = 100 logarithmic nonlinearity of Smith.!° In both cases the 0 dB 
reference input level was determined by trial and error such that the 
total probability of the two largest quantizer output levels (plus and 
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Fig. 5 — (a) Signal-to-noise ratio by simulation. (b) Actual improvement com- 
pared to theoretical. 
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minus) is 0.005. This arbitrary rule was suggested to me by Mr. J. I. 
Kaiser of Bell Laboratories. The noise includes overload noise, and hence 
does not conform to the approximate equation (7). Fig. 5(b) shows the 
difference in dB between the two curves of Fig. 5(a) and also a straight 
line representing the 7.14 dB difference predicted by the theory. The 
results indicate that whereas the theory does not predict the exact im- 
provement it does so within about a dB over an input range of about 30 
dB. Some improvement in the prediction made by the theory would be 
expected with quantizers with larger numbers of steps, since the quan- 
tizing error term in (14) would then be smaller. This would reduce the 
discrepancy created by dropping that term in arriving at the figure of 
merit in (15). But the prediction will never be good in the overload 
region, because under that condition there is a high probability of large 
errors, regardless of quantizer step sizes, and the error samples become 
correlated with each other and with the signal. In addition, some of the 
discrepancy must be due to the fact that the normalized probability 
density of z is not the same as that of x. That assumption was made in 
determining that the figure of merit represented the improvement in 
signal-to-noise ratio. The assumption that the normalized probability 
density of z has a particular shape will be poorest under lightly loaded 
conditions, because the quantizing error becomes a large fraction of the 
signal z. Even when quantizing error is a negligible component of z, the 
result depends on the second-order statistics of the input variable 2, 
and these statistics have been guessed at but are not known. The simu- 
lation was also carried out using another companding characteristic, 
with similar results, but those results are not shown here. 

Observe in Iigs. 6(a), (b), (c), and (d) the normalized probability 
density of z under various conditions of loading. These curves were ob- 
tained from the computer simulation. Note that under progressively 
lighter loads the probability density changes to bimodal. This can be 
explained in terms of the oscillation present in DPCM systems under 
light load when the quantizer is of the midriser type. (See the next sec- 
tion.) The fact that the shape is well maintained in the overload region 
has not been explained on intuitive or theoretical grounds, but note that 
in spite of the shape assumption being met, the variances of x and z do 
not maintain the ratio predicted in (15) because of the error term in z. 

Further evidence related to our assumptions is shown in Figs. 7(a), 
(b), (c), and (d). There the normalized quantizing.error power spectral 
densities for progressively decreased load on the quantizer are shown. 
In the very lightly loaded case, approximating the idle channel, the 
oscillation at the half sampling frequency is clearly shown. This was 
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Fig. 6 — Normalized probability densities of z. Symmetrical average of “+-” and 
ies data; (a) overload; (b) threshold of overload; (c) average load; (d) light 
oad. 


mentioned earlier, and is described in full in the next section. The error 
spectrum remains approximately flat under changing load until the 
overload phenomena begin. In overload a sharp concentration of energy 
at low frequencies occurs. No analytical explanation of this has been 
developed. However, this is not due to a signal correlated component of 
error because that component was removed computationally in arriving 
at the spectra shown. It may be due to a statistical dependence more 
complex than linear correlation, however. The fine structure present on 
the curves should be ignored, since it is due to the truncation in time of 
the autocorrelation data used. 

Finally, we note one additional point. The simulation was done with a 
sampling rate of 9.6 kHz. The sampling rate in Bell System voice-fre- 
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Fig. 7 — Normalized error spectra versus frequency relative to sampling fre- 
quency; (a) overload; (b) threshold of overload; (c) average load; (d) light 
load. 


quency PCM equipment, such as the T1 Carrier System, is approxi- 
mately 8 kHz.!9?! If the value of p; for 8-kHz sampling can be deter- 
mined, a prediction of the advantage of DPCM systems with this sam- 
pling rate can be determined. If the autocorrelation function of speech is 
reconstructed by means of the cardinal series, the value at 0.125 usec is 
determined as 


pil sxkuz = 0.8644. 


All the correlation coefficients determined in this way appear in Table 
I(b). The figure of merit for nonoptimal DPCM is then 


10 logio (SNR IMPROVEMENT | ¢ iatz) = 5.7 dB. (23) 
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This means that for the 8-kHz sampling rate, approximately one digit per 
sample can be saved by using DPCM. 

Not considered in the simulations described here are the variations in 
speech statistics which are known to occur. The usual way of handling 
the volume variation is to use companding to shape the curve shown in 
Tig. 5(a). However, the characteristic number p; will also undoubtedly 
vary among talkers, perhaps correlated in some way with volume. No 
statistics on this are known to the author. 

With the correlation coefficients given in Table I(b), it is possible to 
compute the optimum linear feedback coefficients, from (16). Since 
slightly greater generality is obtained, this will be done for K > o., 
With a signal-to-noise ratio of 30 dB or more, one would expect practically 
negligible difference. Of great interest is the figure of merit calculated by 
(18) as a function of N. Fig. 8 shows this relationship. Note that for 
N = 1, the figure of merit is practically 6 dB, just over that attained by 
the nonoptimal case. For large N the improvement levels off at just over 
10 dB, less than 2 digits better than PCM. Better than 9 of the 10 dB are 
available using only N = 2. No simulations have been run for this type 
of system; hence no check has been made of the assumptions as in the 
nonoptimal case. 
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0 { 2 3 4 5 6 7 8 9 {0 4 
NUMBER OF DELAY LINE TAPS -N 


Fig. 8— Figure of merit vs predictor complexity for 8-kHz sampling. 
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VII. IDLE CHANNEL PERFORMANCE 


Of importance in the design of PCM systems is the so called idle 
channel performance. Shennum and Gray” calculated the output noise 
of a PCM system with low level thermal noise input, as a function of step 
size relative to rms noise, and as a function of the bias of the quantizer 
thresholds nearest the origin. This noise can be larger or smaller than the 
input thermal noise causing it. A phenomenon with similar causes but 
different effects occurs in DPCM systems, and these effects are analyzed 
here. 

In this analysis we restrict ourselves to the nonoptimal DPCM de- 
scribed earlier, and represented, for purposes of analysis, in Fig. 9. The 
Gaussian independent thermal noise samples x; are the input, and the 
samples f; are the output. It is convenient, for analytical purposes, to 
consider uniform quantizer steps with unit step width and height. It is, 
of course, common for speech quantizers to be nonuniform, but the steps 
are generally almost uniform near the origin, the region with which we 
are concerned. The values computed here for idle channel noise should be 
compared with those for PCM when the step sizes are the same. Under 
this condition the systems are approximately equivalent with respect to 
quantizing noise performance. 

The static characteristic of the uniform quantizer we have assumed is 
shown in Jig. 10, indicating the decision levels 6b; , the representation 
levels a; , and the biases A and B. The quantizer is assumed to have an 
infinite number of levels. The biases A and B can represent either drift in 
the quantizer or a deliberate design, or both. In the overall system, the 
decoder at the system output, may exhibit a third bias different from A, 
but that problem is separate from the ones being considered here. There 
is another factor, similar to these biases, which must be considered; it is 
the initial condition on the accumulator output at the outset of the idle 
period. With the exception of the dc level created in f; , and the algebraic 
sign, the initial condition is identical in its effect to the bias B. Hence, 
it is no restriction to arbitrarily choose B, if we wish to ignore the dc 





Fig. 9 — Simplified DPCM model. 
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Fig. 10 — Quantizer definitions. 


level, as long as the full range of initial conditions is considered. For con- 
venience, choose A = B. Then the only two remaining independent 
parameters are the bias A and the initial value, J. 

Under the above set of assumptions we note that the following relations 
hold. 


=, UIE 


= (24) 
bj =a;+3; dir =aj— 3 (25) 
Yi = Aj if ei eae a) Oe ae (26) 


For further convenience, let us assume a particular set of a,’s for refer- 
ence. Let 


a; =j+a pS Ore S28 1, Oe (27) 
Then 
a= a; + A. (28) 


It is sufficient to study cases covering the range —} < A S 3, and in 
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fact symmetry of the system precludes the necessity of studying half this 
range. 

Of interest is the conditional one step transition probability of the 
output value f;. We note this with two subscripts, the second denoting 
the initial value, the first the subsequent value. The superscript indi- 
cates the number of time periods that elapse in the transition. 


Pr+aj.t” = prob fa; — 3 S a; —I < a; + 3}. (29) 
In terms of our previous notations, this may also be written 
Preasieir = prob{j Sa—-I-A<j+)j. (30) 


Equation (30) is the fundamental equation describing the generation of 
the samples f; . However, it still does not give the mean squared value of 
f; nor any other statistical characteristics in which we are interested. 
We may note that the sequence of samples f; is first order Markov, but 
this doesn’t bring us closer to a solution for our problem. 

Let us note that following the initial value J, in one step, there is an 
enumerable set of possible values of f;, of the form {I + a}. (Only a 
small finite subset of this enumerable set have significant probability.) 
Following each of these possibilities in one more step is another enumer- 
able set of possible outputs; but in general the set of possible outputs is 
different following each member of the set {2 + a,;}. This makes the state 
diagram for the sequence of values of f; extremely complicated in general. 
It will be necessary to resort to computer simulation to discover what 
happens in these cases. But under some special assumptions it will be 
possible to carry the analysis further, and we take those cases first. 

Let us first consider the special case, A = —4, called the midtread 
case. Then by (28), a; = j, where? is any integer. Under these conditions, 
the set of possible outputs following J in one step is {2 + 7}, including I 
itself. Following any member of this set in one more step is any member 
of the same set of possible outputs, since the sum of integers is an integer. 
See Fig. 11(a) for a flow graph to further clarify this case. Only three 
output states are shown although an enumerable number is required in 
general. Any member of the output set may be identified by the integer 
appearing in the expression for that member. The conditional one step 
transition probability from any member of the set to any other is written 


pe = prob{j —kh—-34S54,-I-k<j—k+. (1) 


Equation (31) denotes a matrix of values of the conditional transition 
probabilities, which will be called the one step transition matrix, P™. 
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‘ p-i1-1 pP-10 P-1°*’ 
PY = |... Po-1 Po Pu ***]. (32) 
“P31 ©«=Pi = PU 





J 


In general, P™ has enumerable dimensionality, but the probabilities 
become negligible in cases of interest for large enough magnitude of the 
indices, hence truncation of the range of the indices creates negligible 
error. 

Similarly, let us consider the special case, A = 0, called the midriser 
case. Here, a; = j + 4. The first set of possible outputs following I is 
{I + 7 + 4}, a set which does not include J. The next set of possible 
outputs, following any member of the above set is {J + k} where k is any 
integer. The third set of possible outputs, following any member of 
{I + k} is the same as the previous set {f + j + 4}. Hence, there are two 
subsets of the total output set, and the output alternates between these 
subsets. Observe that the flowgraph for this case, Fig. 11(6), has arrows 
only between the two subsets, none within the subsets. (For convenience 
the number of members of each subset has been truncated at three.) 
We may solve the problem of indexing the members of these sets by 
defining the index in the form 


l=2G+%3) =a+1 
for the first subset, and 


ve 2k 


for the second subset. Now with this notation we may write the one 
step conditional transition probabilities as before. 


ie = ierOb o4a} ae pap<i Eth 


IIA 


2 : 2 2 


= 0, 7 — k even. 


Because of the alternation between members of two sets, about twice 
as many possible outputs have to be used in this case as in the first case 
to make the truncation crror negligible. 

Cases with larger numbers of output subsets may be found under the 
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following conditions. Suppose A is any rational number of the form 
+m/n where | m/n| S 4. Then the number of output subsets is 17 if 
is the smallest integer satisfying 


M (3 ok 7) = integer. 


The cases for M = 38, 4, 5, etc., could be worked out algebraically as we 
have for MZ = 1, 2, but those cases become unwieldy by the method being 
used. For clarity, the case A = —§ (MZ = 8) is shown in Fig. 11(c), 
truncated at 8 members of each of the three subsets. 

Let us return to the midtread and midriser cases. It is a simple matter 
to write the conditional probability equations governing the output 
sequence, and then to arrive at expressions for the output power and 
autocorrelation function. We write 


Pp = p© Pe. (34) 


Equation (34) is a form of the Smoluchowski equation. By iteration, one 
can easily solve for P™. 


P® = [P°y. (35) 


Let the a priort probability of the 7th member of the output set be 
designated C’; , and let the square matrix C be formed with major diag- 
onal elements C’;; and other elements zero. The probabilities C’; may be 
determined from P™ by simultaneous solution of the following equations: 


C: = > Cpe? for all z 
allk 


1= Cy. 


allk 


(36) 


Equations (86) are an overdetermined system, but in general there is a 
unique solution, obtainable by not using one of the first group of equa- 
tions. Now the joint probability of the output at a given step and the 
output v steps later may be written as the matrix 


Q®? = PC (37) 


and the autocorrelation as a function of v may be written as the quadratic 
form 


Rv) = fas, (38) 


where f is a row vector for which the elements are the members of the 
set of output values, indexed as indicated when developing these sets. 
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f’ is the corresponding column vector. For purposes of defining 2 (0), 
P is defined as the unit matrix. All the terms on the right side of (38) 
may be evaluated by means of the computer, once the transition prob- 
ability matrix is evaluated. The transition probabilities given by (31) 
or (33) may be evaluated in terms of the probability function assumed 
for the samples x; . It is here that the ratio of variance of x; to the step 
size (unity) enters as a parameter. Since the x; are assumed to be samples 
of thermal noise, the probability density is assumed Gaussian with zero 
mean. The most important computed result is R (0), the mean squared 
output noise relative to the squared step size. The dependence of F (0) 
on the parameters A, J, and x? is shown in Fig. 12. The values shown in 
Fig. 12 vary between the same maximum and minimum values calculated 
for PCM by Shennum and Gray.” Note that the noise exhibits much 
more fluctuation as a function of J in the midtread case (A = —}), 
although its minimum value is smaller. However, the initial condition J 
is a parameter which cannot be controlled in the design; hence, midriser 


0.25 |— 


° 
Ny) 
fo) 


VARIANCE R (0) 


0.05 


“--~A = O MIDRISER 
—A =-5 MIDTREAD 
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Fig. 12 — Idle channel noise in DPCM system. 
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operation is a considerably better choice. The other values of RF (v) 
contribute little by way of additional information except to show peri- 
odicities and de values. In the cases studied to this point, these effects 
were small. Of these two, the midriser case is the only one exhibiting a 
periodicity. The amplitude of the periodicity depends on the initial value 
I. The frequency is the half sampling frequency and is easily filtered out 
in practical systems. This is the same periodicity which showed up in 
the simulation described in Section VI, and which is indicated in the 
noise spectrum shown in T'ig. 7 (a). Aside from the small de and periodic 
components, the output noise samples were uncorrelated. 


Other cases, that is those with other values of A, were solved by simula- 
tion rather than algebraically. This is because the possible output values 
become more closely spaced and much higher dimensionality of the 
matrices is required for accuracy. The simulation is actually quite simple, 
since all the blocks shown in Fig. 9 are already shown as mathematical 
operations. The input samples are taken from a so-called Gaussian ran- 
dom number generator program, which produces essentially uncorrelated 
samples, and having a distribution which is quite accurately Gaussian 
but which truncates at six times the rms value. The output noise level 
showed no marked difference from the two cases already presented. 
Hence, the detailed results will not be shown except for one very interest- 
ing case. As indicated earlier, there are particular values of A for which 
the possible outputs are divided into 3, 4, 5, --- etc., subsets. In these 
cases, the output sequences through these subsets in a definite order, 
although the particular member is chosen randomly. Clearly there is in 
general more than one rational fraction A for a given period M, and the 
pattern followed by the sequence of output subsets may be different for 
different rational fractions that go with a given value of JZ. As a con- 
sequence, there is a periodicity at 4, 4, $ °:- etc., of the sampling 
frequency respectively. This periodicity falls in the band below the half 
sampling frequency, and cannot be filtered out as in the midriser case. 
The sample sequences of the output are not periodic in general because of 
the randomness of the choice of a particular member of each subset. 
However, if in each subset there is one highly probable member and 
others of very small probability, the sample sequences are almost peri- 
odic. In the limit of zero input noise, the output sequence is a periodic 
function. In all cases, the mean and variance are periodic functions of 
time. As an example, a flowgraph for the case M = 3 is shown in Fig. 
11(c). At cut A, all the arrows are from subset 1 to subset 2. No other 
arrows leave subset 1. Similarly, cut B intersects all the arrows from 
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subset 2 to subset 3, and cut C intersects all those from subset 3 to subset 
1. 

For the members of a given output subset, a priori probabilities may 
be computed by the methods indicated in (86), and these probabilities 
can be used to compute the mean and variance for the places in the 
sequence where that subset applies. The mean and variance for a case 
where the periodicity is sth of the sampling frequency is shown in Fig. 
13. In the case of the variance, both the theoretical curve computed from 
the probabilities and the curve obtained from the simulation are pre- 
sented. Good agreement is shown. 

If the value of A is irrational, the sequence of output subsets does not 
close on itself as in the cases indicated here. Hence, the period is not an 
integral multiple of the sampling interval. However, a similar phenome- 
non takes place with respect to periodicity of the mean and variance of a 
continuous signal reconstructed from the output sample sequence. 

With the simulation method it is possible to study cases with non- 
uniform quantizing as well as the uniform cases studied to this point. 
One case with a small amount of nonlinearity was tried but no signifi- 
cantly different phenomena appeared in the results. 

It is clear that the model used here for idle channel noise is not ade- 
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Fig. 13—-Mean and variance of idle channel noise A = —045; W/Z? = 
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quate to describe what goes on in other systems such as DPCM with 
optimal feedback. 

By way of summary, let us note that all evidence presented here points 
to the midriser case (A = 0) as the best one from the system design view- 
point. This is because of the inband periodic component present in the 
output of all of the other cases except the midtread case. The annoyance 
created by these inband periodicities will depend on their amplitude and 
frequency. This could be further studied by the simulation methods, and 
evaluated with subjective tests. But the midriser design should prove 
satisfactory, and additional investigation has not been undertaken. The 
midtread case is the only one showing no periodicity, but it is also the 
only one showing a high degree of dependence of the output variance on 
the initial condition I. Since the value of I cannot be controlled by the 
designer, the midtread case is also unsatisfactory. We note that it is only 
the quantizer output bias which must be controlled closely in the practi- 
cal system, since the input bias change is equivalent to a change of 
initial condition, and we have found no great dependence on this param- 
eter except in the midtread case. 

It may be that the midriser design would no longer appear best when 
one considers crosstalk into an idle channel with a shared coder. Since 
this has not been investigated, no conclusions are presented on this 
point. 


VIII. PRE-EMPHASIS 


Equation (13) shows that in simple DPCM, it is the difference between 
adjacent input samples which forms the principal component of quantizer 
input. This leads one to the idea that a similar performance advantage is 
to be gained by using a pre-emphasis network with PCM. The network 
should approximate a differentiator. The principal qualitative difference 
in performance of this system is that an integrator is needed at the output 
to restore the original signal. This destroys the independence of the error 
samples and creates a subjective change in the output noise. It is not 
known whether frequency weighting of the noise will adequately account 
for the subjective changes. This problem was examined briefly, but is not 
reported in detail here. The pre-emphasis filter can be optimized, subject 
to a frequency weighted error criterion. It was found that, using this 
objective performance measure, an advantage nearly the same as that of 
simple DPCM can be attained. 

Pre-emphasis (and de-emphasis) can also be used with DPCM systems. 
However, the differential aspect of the system makes use of most of the 
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advantage to be gained, leaving little additional for the filtering. In other 
words, the effects are not disjoint. 


IX. SUMMARY 


The results presented have fallen into approximately three categories. 
First, an analysis of signal to quantizing noise ratio has been presented, 
indicating the advantages to be gained by the use of various forms of 
DPCM, including simple DPCM and optimal DPCM with varying 
amounts of memory. The analytical results are discussed in the light of 
results obtained by other authors and the assumptions used. Second, a 
computer simulation was used to check the assumptions implicit in the 
present work and that of others. The probability density of the quantizer 
input and the quantizing error spectrum were studied by the simulation 
technique. The computer was also used to evaluate the performance to 
be expected when DPCM is used for speech transmission. It is shown that 
approximately 6 dB or one digit per sample advantage over PCM is 
attained by the simplest DPCM system. With optimal linear prediction, 
10 dB or less than two digits per sample advantage over PCM is at- 
tained. T'inally, the performance of the DPCM idle channel is investi- 
gated. It is shown that periodicities in the output of the idle channel 
sometimes are present. Amplitude and frequency depend on the bias of 
the quantizer output. It is pointed out that the most satisfactory design 
is the so-called midriser case, where the periodicity is at the half sampling 
frequency and can be filtered out in a practical system. The idle channel 
noise of DPCM varies in a different way from that of PCM. The level of 
the idle channel noise is approximately the same in both PCM and 
DPCM, when the quantizing noise performance is the same. 
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A Stability Criterion for Nonuniformly 
Sampled and Distributed Parameter Systems 


By B. K. KINARIWALA and A. GERSHO 
(Manuscript received May 9, 1966) 


This paper presents a stability criterion for distributed parameter and 
uniformly or nonuniformly sampled systems. Specifically, a finite algorithm 
is presented which tests whether all the zeros of a function of the form 


N 
FC) =)... 66°"; 
n=0 


lie within the intertor of the left half s-plane. Thus, the algorithm tests the 
stability of those systems whose system functions are ratios of finite sums of 
exponentials. Included in such systems are all distributed systems whose 
components are untform, lossless transmission lines and all sampled systems 
with a periodically varying sampling rate. 


This paper presents a stability criterion for distributed parameter 
and uniformly or nonuniformly sampled systems. Specifically, a finite 
algorithm is presented which tests whether all the zeros of a function of 
the form 


‘Cn and tn real 
N 
Pig = >) ee 8 uw = 0 (1) 
n=0 
Unt > Un 


lie within the interior of the left half s-plane. Thus, the algorithm tests 
the stability of those systems whose system functions are ratios of finite 
sums of exponentials. Included in such systems are all distributed systems 
whose components are uniform, lossless transmission lines and all 
sampled systems with a periodically varying sampling rate. 


Criterion: F(s) is of type L; (.e., it has all its zeros in the interior of the 
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left half s-plane) if and only if 


m 


F(s) Es F(—s)e"% a, ane” a 0 
- WY, = C—O SC "| , 9 
(8) = FG) E F(Saew ee 


> b,e""" 
n=0 


reduces to zero/K, (K a constant), under the repeated application of 
the following 


Algorithm: 


Given 


yD Ane” to = 0 
Wau(s) = <= ( ) 


82n? 
oy bne 7 nti > Ln 
n 


(¢) Terminate the algorithm unless 0 < Ry, < # where 


R, = — Fe 
(iz) Using 
Gnu = Rrbau = Gn + Ibn 
Ony = —Ribrny = Gn — Riba 
decompose 


Dy Gnue™ + D7 One” 
WY _1(s) = eee ee . 
k ss bru” ats > be est 
n n 


(zit) Identify the lowest x, with nonzero Any aS Tx « 


(wv) Obtain 


(2n—TK) Sx 
DE tae Sue 
ons aon nu + — nv 
i a ete ae 
>, Onw 7 >, One 


The algorithm is repeated for k = 1, 2, --- , M until it terminates. 
The number of steps // is always finite. 


Proof: The following three observations based upon the results of Ref. 
1 lead to the above criterion. 
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(2) F(s) is of type L, if and only if W,(s) is a positive-real function 
of s. 

The Hadamard factorization theorem’ shows that e’”F (—s)/F(s) is 
analytic in the right half s-plane and it is bounded by one on the imagi- 
nary axis. Hence, W,(s) is a positive-real function of s. Alternatively, for 
real problems (i.e., un rational) a mapping \ = tanh sr can be used to 
reduce Y, to a rational function which is positive-real in \ and the con- 
clusion follows.’ 

(iz) An odd function of the form (2) is positive-real if and only if it 
is the impedance function of a SCULL, ie., a short-circuited 
cascade of uniform, lossless transmission lines.’ 

This is a special case of the realizability theorem in Ref. 1. 

(zit) A function of the form (2) is the impedance function of a SCULL 
if and only if it reduces to (zero/a const.) under a repeated ap- 
plication of the above specified algorithm.’ 

This is actually a synthesis algorithm for the short-circuited cascade 

structure. 
Q.E.D. 
Example: 


F'(s) = 10e!*-** fs Os a got a 5 


14.3 8.2 6.1 
5e  —e ° +e'° — 5 


W(s) = [delt-te — e8-2s — BeSls + 15 
Ger '* = 6 

Wi(s) = 12¢8" + 12 
e€ 

Wo(s) = or’ 


Hence, F'(s) is of type L; and the associated system is stable. 
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Customer Evaluation of Telephone 
Circuits with Delay 


By GEORGE K. HELDER 


(Manuscript received June 9, 1966) 


In 1964 tests were begun in which customers making transatlantic calls, 
to which varying amounts of delay had been added, were interviewed after 
call completion to determine the circuit quality. These tests were continued 
in 19665 using the Early Bird satellite which some customers used extensively 
before being interviewed. During this period a number of different echo 
suppressors were also tested. Results show that the quality of telephone 
circuits with echo suppressors decreases with increasing delay, that previous 
satellite calls have no effect on the customer’s opinion of his present call, 
and that no echo suppressor was superior for all delays although some 
appear to be better for the longer delays. 


I. INTRODUCTION 


Echo occurs on any two-wire or combination two-wire, four-wire 
telephone circuit. The degrading effect of this echo depends on the time 
it takes for the echo to return to the speaker — the delay time. For very 
short echo delays — on the order of a few ms — the echo is masked by 
the sidetone in the telephone receiver. For somewhat longer delays — on 
the order of a few tens of ms — the echo can be made tolerable by provid- 
ing loss in the telephone circuit to reduce the level of the echo. For delays 
longer than this, too much loss is required and echo suppressors are used. 
Echo suppressors are voice operated devices placed in the four-wire 
portion of the circuit which insert loss in the return path to suppress 
the echo. 

When an echo suppressor is in its suppression mode, it places a large 
loss in the echo path which, besides suppressing echo, prevents the 
speech of the second party of the conversation from reaching the first 
party if both are speaking at the same time, i.e., double talking. If the 
echo suppression is removed during double talking, the echo is also 
heard. 
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The speech mutilation and imperfect echo suppression during double 
talking are generally not serious for delays up to about 100 ms. JI*or 
longer delays, the effects can be easily noticed by many conversants 
and become increasingly troublesome as the delay increases. 

Many tests have been conducted during the past few years to deter- 
mine the importance of these subjective effects on telephone communi- 
cations over circuits with long transmission delay. The interest in this 
subject is related to the introduction of satellite communications systems 
with their inherently longer delays than terrestrial circuits. Results 
previously reported have been those gathered in laboratory tests.* 

Late in 1963 a program was instituted to obtain the reaction of real 
users of circuits with different amounts of delay. Initially, the quality 
of circuits from the United States to Europe over cable and the T'elstar® 
and Relay satellites was compared by placing regular commercial tele- 
phone calls over circuits on these media. The users of the circuits were 
interviewed after the completion of the calls and asked whether they 
had had any difficulty in conversing and asked to rate the call Iéxcellent, 
Good, Fair or Poor. It was soon evident that the problems of establishing 
telephone circuits over the experimental satellites were producing quality 
differences which were confounding the desired test results. 

In early 1964, at the request of the Federal Communications Com- 
mission and with the advice and knowledge of the National Aeronautics 
and Space Administration and the Communications Satellite Corpora- 
tion, a new series of tests was begun. These tests, conducted in coopera- 
tion with the telephone administrations in the United Kingdom and 
Trance, resulted in some 3000 interviews of customers who completed 
calls to London and Paris over cable circuits to which varying amounts 
of delay had been added. 

This series of tests was continued in 1965 on circuits over cable and 
the Early Bird satellite. 4000 more interviews resulted. The telephone 
administrations in Germany and Italy, in addition to those in the United 
Kingdom and France, participated in these tests. 

This paper discusses the tests conducted in 1964 and 1965. 


II, 1964 TESTS 


2.1 Test Description 


From January 27 to April 24, 1964, two non-TASI cable circuits from 
New York to Paris and two from White Plains to London were equipped 


* See, for example, Refs. 1 and 2. 
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with special echo suppressors and added delay.* The special echo sup- 
pressors were used in place of the 1A and, in London, the 6A echo sup- 
pressors regularly used on the circuits. A record-reproduce device in- 
serted delay in the outgoing path from the USA as shown in Fig. 1. 
Tour values of total round trip circuit delay were used: 90 ms, 300 ms 
600 ms, and 800 ms.f (A small number of interviews were also made 
using 1000 and 1200 ms delay.) 

Two experimental echo suppressors, designated the B and the L, and 
modified British 6A echo suppressors were used on the White Plains to 
London circuits; the B, L, and modified Bell System 1A echo suppressors 
were used on the two circuits from New York to Paris. The echo sup- 











--—--— 
NEW YORK 1A 
OR ECHO CABLE 
WHITE PLAINS SUPPRESSOR 

















EXPERI- EXPERI- 
MENTAL MENTAL 
ECHO ECHO 
SUPPRESSOR SUPPRESSOR 


Fig. 1— Placement of echo suppressors and delay. 


pressors were rotated on the circuits so as to prevent any differences in 
individual circuit quality from biasing the results. 

The four circuits had essentially the same transmission characteristics 
such as bandwidth, noise and transmission loss. The 3 dB down points 
of the bandwidth were at about 300 and 3100 Hz. The average noise 
level was about 42 dBrnC at the 0 transmission level point.t The circuits 


* TASI, which stands for Time Assignment Speech Interpolation, is a technique 
used to provide more cable channels by time sharing. The circuits used in the 1964 
tests were not derived in this manner. 

¥ The 90 ms minimum value is the sum of the 70 ms inherent round trip de- 
lay of the cable plus 20 ms, which is the minimum delay introduced by the Echo- 
Vox. The Echo-Vox delay units were used on all calls including the control, mini- 
mum delay, calls. It can be shown that providing a lumped delay equal to the 
round trip delay in one direction of transmission only is, from the point of view of 
the speakers and the echo suppressors, equivalent to splitting the delays equally 
between both directions. 

tdBrnC is dBrn as measured with a Western Electric 3A Noise Measuring Set 
with C Message Weighting. 
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were given special access codes* and were used as first choice circuits 
for outgoing calls from New York City to London and to Paris between 
the hours of 9:00 a.m. and 2:00 p.m., New York time, on weekdays. 
The traffic placed over the circuits was representative of the total traffic 
occurring during the test hours. 

The operators using the circuits had no knowledge of the echo sup- 
pressors or delays being used, and they were given no special instruc- 
tions other than those on the use of the specially coded circuits. The 
operators noted on the call ticket the access code used in addition to 
the normal information on party identification, call timing, ete. 


2.2 Echo Suppressor Description 


The pertinent parameter values of the echo suppressors used in the 
test are shown on Table I. The echo suppressor designated 1 is the modi- 
fied 1A; 6 is the modified 6A. 

Of the four echo suppressors used, the modified 6A and 1A echo sup- 
pressors were very similar. Both combined the suppression control and 
differential action into one circuit.t This does not allow a loud talker to 
remove suppression caused by a weak talker until the suppression hang- 
over has expired. The modification in the 1A consisted of a 10 dB higher 
sensitivity and increased suppression loss. The modified 6A had a 
changed sensitivity frequency characteristic. This change was observed 
by the British Post Office (BPO) to produce suppression for lower level 
speech sounds with no increase in operation on noise. 

The L echo suppressor, an experimental model of a United States 
manufacturer, was distinguished by its action during double talking. 
When this occurs the suppression was removed immediately, and 6-dB 
attenuation was inserted in both the receive and transmit paths to re- 
duce the echo which was unsuppressed at this time. The hangover on the 
break-in circuit was about 30 ms. Another unique feature of this echo sup- 
pressor was the hysteresis effect present in the suppression and break-in 
circuits. The signal level required to release from the suppression mode 
was about 9 dB below that required to operate. 

The B experimental echo suppressor, a Bell Laboratories model, was 
similar to the L in that suppression is removed immediately when double 
talking was detected. It was, however, unique in the long break-in hang- 

* An access code is a three digit number usually associated with one country. 
When keyed by the overseas operator, it directs the call through the gateway 
switching machine to the group of circuits to that country. The special access codes 
here directed the calls to selected subgroups of the circuits to London and Paris. 


+ For a more complete description of the modified 1A and the B echo suppres- 
sors, see Ref. 3. 
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TABLE I] — CHARACTERISTICS OF THE ECHO SUPPRESSORS IN THE 1964 
Tests (NoMINAL or TypicAL MEASURED VALUES) 


Echo Suppressor 
Suppression 
1 6 B L 

Operate sensitivity* —4l —26 —31 —32 
Release sensitivity —44 —29 —33 —Al 
Pick-up timet 10 4 8 1 
Hangover time 50 50 50 30 
Bandwidth Peaked at 1000 | Peaked at 3500 | Flat over | Flat over 

Hz, 20 dB Hz, 7 dB rise} the voice] the voice 

down at 500 from  1000- band band 

and 2000 Hz 2000 Hz 

Break-In 
Operate sensitivity —41 —26 — 26 —36 
Release sensitivity —44 —29 —27 —4I 
Pick-up time 50t 50t 10 1 
Hangover time 20 50 _ 200 30 
Bandwidth Same as Suppression 
Loss During Double Talking 

1 None 
6 None 
B 6-dB attenuation in transmit path. Speech compressor in the receive path 


with 0-dB attenuation for a —40 dBm signal and 18-dB attenuation for a 
0-dBm signal at the 0 transmission level point. 
L 6-dB attenuation in both the receive and transmit paths. 


* All sensitivity values are given in terms of the power level of 1000-Hz signal 
in dBm at the 0 transmission level point. 

+ All times are in msec and are measured using a 1000-Hz signal level 3 dB above 
the operate sensitivity. 

t In the presence of a suppressing signal in the receive path, break-in does not 
occur until the suppression hangover time expires. 


over time (200 ms) and in the insertion of a speech compressor during 
double talking to reduce the echo. 


2.3 Interviewing 


The method used to determine the subjective evaluation of circuit 
quality was the customer interview. The parties using the circuits were 
called back and interviewed by specially trained personnel in New York, 
London, and Paris after call completion. Fig. 2 gives the form of the 
questionnaire.* Every effort was made to use the same or equivalent 
forms and techniques in New York, London and Paris. The interviewers 


* Fig. 2 is the form used in the 1965 tests. The wording of the questions on the 
1964 form was essentially the same. 
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no. LET TTI conv. Start Time LT TL} elapsed tine [ T ] 


123 4 5 67 8 9 0-121 

Time First Attempt Starts Time Interview Starts 
12 13 14 15 16 17 18 19 
1. I am Mrs. calling from the telephone company. We Yes [_] 20-1 
are making a study of our overseas connections. Do you have a no (J ~2 

moment to answer a few brief questions? 

2. Our records show that you made an overseas call to (the United Yes [] 21-1 
Kingdom, Paris, Germany) a short while ago. Is that correct? No oO 2 
3. Did you or the. person you called have any difficulty No Difficulty [_] 22-1 
talking or hearing over that connection? (Interviewer: Some Difficulty [7] -2 








If difficulty, probe and record verbatim - distinguish 
between called and calling parties.) 


Near Far 
23 24 25 26 27 28 29 30 











Excellent (_]31-1 EX + GD(J -2 


4. Which of these four words comes closest to : .. 
describing the quality of that connection: Good (] e cb + FR(] -4 
Excellent, Good, Fair or Poor? Fair[] -5 FR + PR[] -6 


Poor[] -7 It varies[] -0 


5. About how many times a month do you talk on the 
telephone with someone in (the United Kingdom, Paris, Calls per month 
Germany)? (Interviewer: If first call,skip to Q.7) 


Other Period Stated 32 33 
6. On your usual call to (the United Kingdom, Excellent (_]34-1 EX + GD[] -2 
Paris, Germany) which of these four words 2 . 
comes closest to describing the quality of Good (] 2 GD + FRU] -4 
that conaection: Excellent,Good,Fair, or Poor? Fairl] -5 FR + PR(_] -6 
Poor(] -7 It varies[_] -0 
7. Do you have any other comments you would like Yes (J35-1 


to make about your overseas telephone service? 


No [] -2 








36 37 38 39 40 41 42 43 44 45 











8. Thank you very much for your help. 


Accent: None [_]46-1 Reasons for Was any person § Yes (_]51-1 
light & non-completion that answered = 
SMabe Lap ne of interview 47 48.49 50 irritated? Nol s#2 
Heavy [_[] -3 


Interpreter [7] -4 


Time Contact Number of Number of Coder No. of Coder 
Ended nae Interviewer (| of Question 3 [| of Question 7 = 
52 55 56 


57 58 
Circuit Condition CJ Exposure [] 60-1 
59 O -2 


Fig. 2— The interview form used in the 1965 tests. 


CUSTOMER EVALUATION 1163 


in New York were employees of a survey firm specializing in this type 
of work; in London and Paris they were telephone administration per- 
sonnel who were given special training in interviewing. The interviewer 
had no knowledge of the type of circuit on which the call was made. 
No person was interviewed more than once. All interviews were during 
normal business hours and were completed the day the call was made. 


2.4 Results 


2.4.1 General 


The primary measures of the subjective effects of transmission delay 
are the answers to questions 3 and 4 of the interview which concern 
difficulty in talking or hearing and quality rating. These questions were 
asked of customers in three locations: New York City, London, and 
Paris. The interviews in New York City have been separated into those 
on calls to London through the White Plains gateway and those on calls 
to Paris through the New York gateway. The customers used circuits 
with one of four different echo suppressors: 1, 6, B, and L; and had one 
of four values of delay: 90, 300, 600, and 800 ms. About 60 interviews 
were completed for each of the combinations of city, echo suppressor 
and delay. A total of about 3000 interviews resulted. 


2.4.2 Itffect of Delay 


The interview results, pooled over echo suppressors and cities, are 
shown on Fig. 3, where the percentage of interviews reporting difficulty 
and having a fair or poor rating are plotted.* For delays of 90, 300, 600, 
and 800 ms each point represents about 750 interviews. The 1000 ms 
point represents 175 and the 1200 ms point 75 interviews. These last 
were taken during a two week pilot test prior to the main test and used 
the L and B echo suppressors only. 

It can be seen that the fair or poor rating is similar to the difficulty 
measure. This similarity is also present when, as below, echo suppressors 
and cities are separated. 

The rating of transmission quality (question 4) as a function of delay 
is shown in Fig. 4. Data from all cities and suppressors are combined. 
The percentage of excellent ratings decreases almost linearly with delay 
while both the poor and fair ratings have steeper slopes at higher delays. 


* Also shown are 1965 test results discussed later. 
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Fig. 3 — Effect of transmission delay. 
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Fig. 4 — Rating of the calls. 
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2.4.3 Comparison of Echo Suppressors 


Fig. 5 shows the percentage difficulty broken down for each echo sup- 
pressor separately. If the values shown in Fig. 3 are taken as the true 
mean, for each amount of delay, of the population of all interview results, 
then all but one of the values shown on Fig. 5 fall within the 95 percent 
confidence limits on the mean. The implication is that the differences 
among echo suppressors must be interpreted with caution since it is 
conceivable that the differences are due to chance sampling. It will be 
shown later that there is a more significant difference among echo sup- 
pressors in the specific types of difficulties they produce. 


2.4.4 Comparison of Cities 


The four “cities” we compare are actually three. Calls were received 
in London and Paris and were originated in New York City going via 
the White Plains gateway to London and the New York gateway to 
Paris. Hence, our four cities, New York (N), Paris (P), White Plains 
(W) and London (L). 

The difficulty percentages combined over echo suppressors are shown 
on Tig. 6. An analysis of variance shows that, taking all delays into 
consideration, there is no significant difference among the cities. How- 
ever, considering 90 ms only, there is a large difference between the 
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Fig. 5 Comparison of echo suppressors. 
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Fig. 6 — Comparison of cities. 


results for New York City interviews on calls to London — W inter- 
views, and on calls to Paris — N interviews. This difference also shows 
up in the usual call rating (Section 2.4.6) and in the 1965 tests (Section 
3.4.3). 


2.4.5 Comments 


Those persons who had difficulty generally also described the diffi- 
culty they experienced. The difficulties, as stated in the users own words, 
are not always easy to classify. A three-man committee composed of 
persons from the Bell Telephone Laboratories, National Aeronautics 
and Space Administration, and Communications Satellite Corporation, 
without any knowledge of the echo suppressor or delay relating 
to each comment, classified the comments into 18 different types. The 
percentage, by type, of the total comments for all delays, echo sup- 
pressors and cities is shown on Fig. 7. Occasionally more than one type 
comment resulted from one interview. 

The comments made by the users are also shown divided into com- 
ments they made about their difficulties (near end) and comments made 
about difficulties experienced by the other party (far end). 

The relationship of comments to echo suppressors is shown on Fig. 8. 
The types of comments shown are those which are grouped on Fig. 7. 
For each comment four points are shown— one for each delay. The 
points represent the percentage of interviews which both had a ‘‘yes” 
answer to question 3 and which had a comment of the type shown, except 
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for the favorable comment points. In all but one case of favorable com- 
ments, no difficulty was reported and the comments were freely given. 

Some things are readily apparent from Fig. 8. First, favorable com- 
ments generally decrease with delay; second, cutting comments generally 
increase with delay; third, echo and delay comments occur too rarely to 
permit meaningful interpretation. There is no clear pattern to most of 
the rest of the comment types. At the longer delays the B echo suppres- 
sor produces less cutting comments than the other echo suppressors. It 
is believed that this is due to the longer break-in hangover time and the 
insertion of the speech compressor during double talking. 


COMMENTS ABOUT NEAR END 


22% 


CUTTING 
CUTTING 
INTERMITTENT CUTTING 
CUTTING-START OF CALL 
CUTTING-END OF CALL 
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Fig. 7 — Percent of total comments by type. 
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Fig. 8 — Comment types by echo suppressor. 
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2.4.6 Rating of Usual Call 


Those interviewed who were not first time users of circuits to London 
and Paris replied to question 6 on the rating of their usual call. The re- 
sults are shown on Fig. 9 pooled over cities and echo suppressors where 
each point represents about 700 interviews. (Also shown are 1965 results 
discussed later.) The usual call ratings change little with delay while 
the ratings of the present call, Fig. 4, are strongly affected by delay. 
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Fig. 9 — Rating of the usual call. 


The average rating of the usual call is essentially independent of the 
average rating of the present call. Also of interest is the rating of the 
usual call compared with the rating given the present 90 ms call which 
is very similar in quality to the usual call.* The usual call ratings show 
fewer excellent and considerably more fair ratings than the present call. 
The predominant rating of the usual call is good. This may be due to 
an averaging by the customer of all his previous calls which can range 
from excellent to poor. 


* The usual call is either non-TASI or TASI cable using 1A or equivalent echo 
suppressors. 
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The usual call ratings for each city separately, combined over delay 
and echo suppressors, are shown on Fig. 10. The differences in quality 
of the usual call to London and Paris for the New York City party (W 
and N) are consistent with the 90 ms results shown on Fig. 6. The differ- 
ences between the London and Paris usual call ratings could easily be 
due to the differences of the population of users in the two cities. 


2.4.7 Length of Conversation 


The length of conversation was not related to the transmission delay 
as shown on J'ig. 11. Prior to the test it was speculated that conversation 
time might decrease because of decreased satisfaction with the circuit 
quality, or might increase because of the lost information during times 
of echo suppressor mutilation and confused situations. Additional analy- 
sis shows no significant correlation bewteen the length of conversation 
and the percentage of customers reporting difficulty. 
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Fig. 10 — Rating of the usual call for each city. 
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Fig. 11— Average length of conversation. 


2.4.8 Speech Volume 


Speech volume measurements were made on most calls by craftsmen 
using VU meters. Some 4500 measurements indicate that the volumes 
for each delay were very similar. The greatest difference of averages 
between any two delays was 0.8 dB. 

The percentage of customers reporting difficulty as a function of their 
volume is shown on Fig. 12 where a trend towards more difficulty for 
higher volumes exists (or conversely, higher volume for more difficulty). 
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Fig. 12 — Effect of speech volume on difficulty. 
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Each point shown represents between 64 and 608 volume measurements. 
Also shown on Fig. 12 is the difficulty as a function of the received volume 
of the other party (not the interviewee). Here the trend is reversed, the 
interviewed party having less difficulty as the far party’s speech volume 
increases. Each point represents between 182 and 480 volume measure- 
ments. 

These trends might reasonably be expected. The louder one party 
talks, the more likely he will control the echo suppressors and cut off 
the interrupting speech of the far party. This also is more likely to hap- 
pen if the far party is a low level talker. Additionally, this low received 
level itself may cause difficulty for the interviewed customer in the ab- 
sence of any double talking. 


2.4.9 Interviews at Both Ends 


On 1000 calls it was possible to interview both parties to the conversa- 
tion. Table II presents the percentage of calls on which the various 
combinations of difficulty were present. 

What one can say is that if either party to the call reported difficulty 
there is a 50-50 chance the other party also will report difficulty, and if 
either party reported no difficulty, there is about a four to one chance 
the other will also report no difficulty. The results for Paris and London 
separately are very similar. 


III. 1965 TESTS 


3.1 General 


In the 1964 tests the customers had only one exposure to long delay 
before interview. It had long been thought that frequent users of long 
delay circuits may react differently than those who seldom use them. 
It, was unknown whether these heavy users would accommodate to the 
delay and echo suppressors or become more critical or neither. The ad- 
vent of the Early Bird satellite provided the opportunity for investiga- 
tion. 


TABLE IJ — PERCENTAGE OF CALLS WITH DIFFICULTY 


Europe End 
USA end 
Yes difficulty No difficulty 


Yes difficulty 15% 14% 
No difficulty 14% 57% 
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The principal tests in 1965 (termed Part A) were aimed at determining 
the subjective quality of satellite circuits when: 
(z) both satellite and cable circuits were in general use, 

(77) the presence of both types was common knowledge, 

(277) the novelty, if any, of satellite circuits had worn off, and 

(tv) heavy users of transatlantic circuits had used the satellite ex- 

tensively. 

To provide a baseline for comparison, the quality of non-TASI cable 
calls was also evaluated and, in a later part of the test, an evaluation 
of cable circuits derived by TASI was also made. 

Another series of tests, termed Part B, was conducted to evaluate a 
number of different connections, which may be typical in the future, 
involving satellite circuits with different types of echo suppressors at 
the two ends or with other echo suppressor-equipped circuits in tandem. 


3.2 Part A Test Description 


Commercial transatlantic telephone communications via the Early 
Bird satellite began June 28, 1965. From that date until November 12, 
1965, all weekday satellite traffic to and from the United Kingdom, 
France, Germany, and Italy was restricted to that originating or termi- 
nating in New York City (except for that in the Part B tests, to be dis- 
cussed later). A punched card record of each call was kept by each ad- 
ministration from whose national network the call originated. The 
punched card data included the names and telephone numbers of calling 
and called parties, test day, call timing, country identification, and 
customer recall of the originating operator. Copies of all punched cards 
were regularly forwarded to Bell Telephone Laboratories where they 
were combined to give the complete satellite calling history of each New 
York City overseas customer. 

The calling history was complete for all weekday calls to and from 
these four countries for each New York City telephone number. Where 
different telephone numbers were used by one customer it was some- 
times, but not always, possible to relate the calls on each number to the 
same customer. Calls made on weekends or holidays or to other countries 
having satellite circuits were not included in the call record cards.* 
About 50,000 call record cards were kept. 

Interviewing of New York City customers began on September 7 for 
calls on the satellite and on non-TASI cable, and on October 29 for calls 

* During the tests, 61 Early Bird circuits to Europe were in use. Two of these, to 


the United Kingdom, were used in the Part B tests. Of the remaining 59, 46 or 78 
per cent were to the four countries involved. 
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on TASI cable circuits. The interviews continued through November 19. 
Satellite and non-TASI cable interviews were conducted on calls from 
the USA to the United Kingdom, France, and Germany; TASI inter- 
views were made on calls to the United Kingdom and France only. 


3.3 Part A Circuit Description 


Kssentially the whole group of TWarly Bird circuits to cach country 
was used for interview calls. The circuits were given special access codes 
and used for New York City traffic only. 

A representative sample of cable circuits — 8 cable circuits to France, 
7 to the United Kingdom, and 2 to Germany — were removed from 
general message use, assigned special access codes and used exclusively 
for New York City traffic. The cable circuits to France and the United 
Kingdom were in turn divided into two groups with separate access 
codes, and the groups were alternately made non-TASI or TASI follow- 
ing a weekly schedule. 

The operators handled traffic on all cable and satellite circuits in the 
same manner and noted on the call ticket the access code used. Subse- 
quent to the interview, the access code was used in the analysis to sepa- 
rate the calls into non-TASI, TASI, and Early Bird calls. 

The non-TASI circuits to the United Kingdom were in the Cantat 
and TAT-3 cables. When derived from TASI, the circuits had equal 
probabilities of using Cantat, TAT-1 and TAT-3 cable channels. The 
non-T ASI circuits to France used TAT-2, TAT-3, and TAT-4 channels 
which were also used for the TASI derived circuits. The two non-TASI 
circuits to Germany used channels in TAT-4. 

Noise and loss measurements were made regularly on all channels. 
Those made at the New York and White Plains testboards are shown 
in Table III. The noise values are corrected, i.e., those which would have 
been present had the average loss been zero dB. 

The delay at 2000 Hz on two London Early Bird circuits was measured 
from White Plains when operating with the ground station at Raisting, 


Taste III — Noise anp Loss MEASUREMENTS 








Loss Noise 
Average Std. dev. Average Std. dev. 
(dB) (dB) (dBrnCO) (dB) 
Early Bird —0.26 0.98 42.8 2.8 
Non-TASI circuits in test 0.17 1.16 43.0 2.0 
All channels used in TASI 0.21 1.4 43.2 2.3 
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Germany and found to be 544 ms round trip. The round trip delay on a 
TAT-1 circuit was 73.5 ms and for a TAT-8 circuit 86.5 ms. The band- 
width of the Early Bird circuits at the 3 dB down point was about 170 to 
3400 Hz; for the TAT-3 cable circuit it was 230 to 3200 Hz. 

The normal echo suppressors were used on the cable circuits. These 
are the Western Electric 1A in the USA and France and Germany, and 
the GPO 6A in the United Kingdom.* The Western Electric 2A echo 
suppressor was used at both ends of all Early Bird circuits. Its operation 
is similar to the B echo suppressor without the 6-dB attenuation in the 
transmit path. 


3.4 Part A Results 


3.4.1 lWffect of Exposure to Satellite Delays 


The pooled results of interviews made in New York City on calls to 
the United Kingdom, France, and Germany are shown on Fig. 13. 
A heavy user is here defined as one who made or received six or more 
satellite calls prior to being interviewed, including the call leading to the 
interview if the interview was made after a satellite call. Statistical tests 
indicate that the differences between the interview results for light and 
heavy users after both cable and satellite calls are not significant at the 
0.05 level. This applies to both the percent difficulty and percent fair 
or poor. t 

Table IV gives a more detailed breakdown of satellite exposure prior 
to interview. The division between light and heavy users at six satellite 
cells is arbitrary. On the basis of other divisions, however, one would also 
probably conclude that there is no significant change in the results 
with increased exposure. 

In all further presentations of results, heavy and light user interviews 
will be pooled. 


3.4.2 Comparison of Cable And Satellite Circutts 


The interview results for non-TASI, TASI and Early Bird circuits 
pooled over all countries and over heavy and light users are shown on 
Tig. 14. The differences between non-TASI and TASI cable are not 
statistically significant; those between the cable and Early Bird are 
highly significant. 

* See Ref. 3 for a description of the 1A echo suppressor. The 6A is very similar. 


7 The largest difference is in fair or poor scores on satellite circuits. This differ- 
ence would have to be 6.4 percent to be significant at the 0.05 level. 
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Fig. 13 — Comparison of light and heavy users of satellite circuits. 


The rating breakdown is shown on Fig. 15. In addition to the break- 
down for all calls, the ratings for those calls on which difficulty was or 
was not reported is also shown. This was done to see if there was perhaps 
a difference in the ratings given to calls with difficulty whether on cable 
or satellite. It was thought that there could be a difference in the severity 
of the difficulties experienced on the two types of circuits which would 


TABLE LV — InteRvVIEW RESULTS 


Cable Interviews Satellite Interviews 
No. of satellite 
calls prior to an to ois S| 
interview No. of Percent Percent No. of Percent Percent 
interviews difficulty | fair or poor | interviews difficulty fair or poor 
0-1 987 12.1 12.7 712 25.3 21.5 
2-3 181 13.3 11.6 330 26.4 25.0 
4-5 54 13.0 14.8 85 27.1 25.9 
6-7 25 12.0 8.0 60 21.7 20.0 
8-9 19 10.5 15.8 58 19.0 16.4 
10-11 11 9.1 18.2 30 23.3 20.0 
12-13 7 14.3 14.3 20 25.0 15.0 
14-15 4 0 0 7 0 14.3 
16 & Over 6 0 0 33 30.3 21.2 
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Fig. 15 — Rating of the calls. 
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show up in the ratings. The similarity of the ratings of the two types of 
circuits within both ‘yes’ and ‘no’ categories of difficulty suggests that 
there is no difference. 


3.4.3 Comparison of Countries 


The interview results broken down by country of destination are 
shown on Tig. 16. The following differences between the United King- 
dom and France are statistically significant: 

(1) TASI fair or poor ratings (significant at the 0.01 level). 
(ii) Non-TASI difficulty (significant at the 0.01 level). 

(221) Non-TASI fair or poor (significant at the 0.05 level). 

Between the United Kingdom and Germany only the non-TASI diffi- 
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culty difference is significant at the 0.05 level. No other differences be- 
tween countries shown on ig. 16 are significant. In Section 2.4.4 the 
differences between interviews on calls to London and Paris for low 
delays are mentioned.* The reason for this consistent difference is not 
known. 


3.4.4 Comparison of Ground Stations 


During the test period, the ground stations at Goonhilly Downs, 
Pleumer-Bodou and Raisting worked with Andover on a weekly rotating 
basis. The ground stations fed the international gateways in a triangular 
interconnecting circuit arrangement shown simply on Fig. 17. The ground 
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Fig. 17 — Europe Early Bird network. 


station at Goonhilly alternately distributed the continental traffic 
through Frankfurt and Paris via London. 

The interview breakdown by ground station, pooled over countries, 
is shown on Fig. 18. None of the differences are significant. A further 
analysis for each country separately also fails to yield significant differ- 
ences, e.g., the United Kingdom results are the same for all ground 
stations. 


3.4.5 Customer Comments 


Prior to the 1965 tests, the comments made in the 1964 tests were 
analyzed to determine the most descriptive words. These descriptive 
*TIn the 1965 tests 84 percent of the interviews on United Kingdom circuits were 


on calls to London and 90 percent of the interviews on France circuits were on calls 
to Paris. 
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Fig. 18 — Comparison of ground stations. 


words were then related to nine categories of difficulty and one favorable 
category, and a dictionary was prepared. The categories were a col- 
lapsed version of those used for the 1964 test as shown below. 


Dictionary coding 


1 Cutting 


2 Low Volume 


3 Fading 


4 Noise 

5 Echo 

6 Distortion 
7 Delay 

8 Crosstalk 

9 Unclassified 


10 Favorable 


1964 cable test coding 


Cutting on and off 
Cutting at start 
Cutting intermittent 
Break-in difficulty 
Cutting at end 

Low volume 

Low volume at start 
Low volume intermittent 
Fading 

Fading intermittent 
Noise 

Echo 

Distortion 

Delay 

Crosstalk 
Unclassified 

Circuit cut off 
Favorable 


The interview supervisor, a senior interviewer, coded the comments 
made in the 1965 test into these ten categories using the dictionary as a 
guide. Fig. 19 presents the frequency of each type of comment in terms 
of the percent of all interviews having comments of the type shown. 
These include comments relating to the difficulties encountered by the 
near (interviewed) party and by the far party as described by the near 
party. In some cases interviews had comments classifiable into more 
than one category and occasionally both the near and far parties had 
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the same type of difficulty. About five percent of the customers who 
stated they had no difficulty, and were recorded as such, also made a 
classifiable comment about difficulty on the circuit. These data are in. 
cluded. On about two percent of the interviews, a favorable comment 
was made about transmission for one party along with difficulty com- 
ments about transmission for the other party. 

It can be seen that in general the differences between the percentages 
shown are small and not consistent when comparing non-TASI and 
TASI. When comparing cable and satellite circuits the differences are 
consistent and, in many cases, statistically significant. The troubles 
experienced by the users of the satellite circuits appear to be caused in 
large part by the action of the echo suppressor as evidenced by the large 
increase in the cutting, fading, and echo comments. The delay per se of 
satellite circuits does not appear to be noted by the customers, but rather 
it is the delay in combination with the necessary echo suppressors. 


3.4.6 Rating of the Usual Call 


The customer’s rating of the usual call was asked in each interview 
in order to be able to interpret his rating of the present call relative to 
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his rating of his usual call to the same city. The usual call ratings for 
interviews on cable and satellite are shown on Fig. 9 where it is seen 
that they are very similar to those of the 1964 tests. 

The relation between present and usual call ratings is shown on Fig. 
20 in terms of the percentage of people who rated the present call one, 
two or three rating steps better or worse than their usual call. The satel- 
lite interviews have more present calls rated one, two or three steps 
poorer than the usual call than do the cable interviews. On both satellite 
and cable interviews, however, there are more cases in which the present 
call is rated better than the usual call than cases where the present call 
is rated worse than the usual call. 

The usual call ratings for each country separately, combined over 
cable and satellite interviews, are shown on Fig. 10. A comparison of 
the W and United Kingdom and the N and Trance bars shows good 
agreement between the 1964 and the 1965 Part A tests and suggests 
that the population of customers and the usual call quality are the same 
in both tests. 

As mentioned in Section 2.4.6, the respondents tend to give their 
usual (presumably cable) call a predominant rating of good and this 
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Fig. 20 — Rating of the present call expressed as the difference in rating steps 
from “the usual call. 


CUSTOMER EVALUATION 1183 


differs from the rating given present cable calls from essentially the 
same population of calls. This difference in ratings has been noted in 
several other tests. Because of this effect it is not appropriate to com- 
pare ratings of the usual calls and ratings of present calls using different 
facilities to determine relative transmission quality without compensat- 
ing for the above described tendency. 


3.4.7 Length of Conversations 


As shown on I’ig. 11, the average conversation length was essentially 
the same for cable and satellite calls. 


3.4.8 Time of Conversation 


Almost all interviews were made on calls which occurred between. the 
hours of 8 a.m. and 2 p.m. New York time. These hours include the 
busiest traffic hours and an hour or so of lghter traffic before and after 
the busy hours. The assumption that the rate of customer difficulty in- 
creases with traffic density was tested. The following positive significant 
correlations with traffic density were found: 

(¢) Difficulty and fair or poor on United Kingdom TASI circuits. 
(21) Fair or poor on United Kingdom non-TASI circuits. 
(iz) Fair or poor on France non-TASI circuits. 

(iv) Difficulty on France Early Bird circuits. 

(v) Fair or poor on German non-TASI circuits. 

The reason for these correlations is not known. The correlations are 
not consistently associated with any country or type of circuit. 


3.5 Part B Test Description 


The Part B tests were conducted on two Early Bird circuits to London 
equipped with special echo suppressors. Traffic between the United 
Kingdom, excluding London, and 21 numbering plan areas surrounding 
but excluding New York City was placed on these circuits and the 
parties were interviewed after call completion. Confinement to the 21 
NPA’s prevented the inclusion of tandem echo suppressors in the United 
States Direct Distance Dialing (DDD) network. 


3.6 Part B Echo Suppressors 


The echo suppressor combinations used on the circuits are shown on 
Fig. 21. The 2A and 6A echo suppressors have already been described. 
(The 6AF is a full version of the GAS used on cable circuits.) When used 
as split (6AS) echo suppressors, condition 6, 2-ohms delay was inserted 
between the two 6AS echo suppressors and —50 dBmO (psophometric) 
of noise was injected. 


1184 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1966 


WHITE PLAINS LONDON 
OVERSEAS TERMINAL OVERSEAS TERMINAL 










TO SATELLITE To 
EASTERN CIRCUITS UNITED 
UNITED STATES@4® 2 s—“<‘<‘i«is KINGDOM 
USERS USERS 
(LESS NYC.) 4 (LESS LONDON) 


Fig. 21 — Part B circuit combinations. 


The RC4 is a British Post Office experimental echo suppressor de- 
signed for long delay circuits. Its distinguishing features are a shaped 
frequency response in the control circuit path (like the modified 6A of 
Table I), a break-in hangover of 300 ms and 6 dB of loss inserted in the 
receive path during double talking. 

The EF echo suppressor, a Bell Laboratories experimental model, is 
a full echo suppressor proposed as a replacement for the present Western 
Electric 1A in most domestic applications. It is much like two 2A echo 
suppressors back to back without speech compressors in the transmis- 
sion paths. 


3.7 Part B Test Results 


3.7.1 Comparison of Echo Suppressor Conditions 


The Part B results of interviews in the United States only are shown 
on Fig. 22. An analysis of variance shows that, taken as a group, there 
are no significant differences among the six conditions. 

The average percentage difficulty for all conditions in the Part B 
tests was 42.4 and the average percentage fair or poor was 27.9. These 
values are close to those for condition 1 which used 2A echo suppressors 
only. It will be noted that these percentages are considerably different 
from those in the Part A tests for calls to the United Kingdom which 
were 25.1 percent difficulty and 21.6 percent fair or poor. The reason for 
this is not known. The populations of users were different in that the 
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Part A customers were in New York City and conversed, in most cases, 
with someone in London, while the Part B customers were in the eastern 
United States and conversed with someone in the United Kingdom ex- 
cluding London. This may result in somewhat poorer circuit quality. 
Speech volume readings were made at the London gateway by the 
British Post Office, and the average transmitted volume to New York 
was 2.3 dB lower in the Part B tests than in Part A. As discussed in 
Section 3.4.8, this contributes to poorer quality. The ratings of the usual 
calls are also lower in Part B than in Part A. 


3.7.2 Rating of the Usual Call 


The usual call ratings are shown on Fig. 10 along with those Part A 
calls to the United Kingdom. This shows the higher percentage of fair 
ratings and lower percentage of excellent and good ratings in the Part 
B tests. No interviews were made on cable calls in the Part B tests so 
no comparison can be made between usual and present calls. 


3.7.3 Customer Comments 


One way of comparing the types of difficulties produced by the com- 
binations is as follows. Combinations 1, 2, and 3 involve no tandem echo 
suppressors and the comments are therefore pooled. Combination 4 has 
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a tandem suppressor at the near end. Combinations 5 and 6 have tandem 
suppressors at the far end, and these comments are pooled. Taking the 
sum of all customer comments (excluding favorable) for each of the 
three classes of circuits above, one can then determine the percentage 
of the difficulty comments falling into each category, rather than the 
percentage of interviews having comments in each category. This has 
been done and is shown on Jig. 23. As would be expected, the tandem 
echo suppressor combinations generally produce a greater proportion 
of cutting and fading comments and fewer echo and crosstalk comments. 
(A customer comment about fading can relate to echo suppressor action, 
and echo is sometimes described by the customer as ‘‘other voices on 
the line,” i.e., crosstalk.) 


PERCENT OF COMMENTS 
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Fig. 23 — Comment breakdown. 
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IV. INTERVIEWING 


4.1 Technique 


Most of the interviewers in 1964 and 1965 were housewives who inter- 
viewed on a part-time basis. They had previous training in interviewing 
by their employer and were given two days of specialized training for 
these tests. 

The interview took an average of 2.1 minutes to complete. About 0.6 
percent of the customers in 1965 expressed some irritation about being 
interviewed. Although no count was taken, a sizable percentage of inter- 
viewees expressed some pleasure about being interviewed. 

In 1964, the average time from call completion to interview comple- 
tion was considerably less than one hour and in many cases only a few 
minutes. During the much more complex 1965 tests, the average time 
was greater than one hour. Some 81 percent of all interview attempts 
in 1964 resulted in a completed interview and this high percentage is 
due mainly to those interviews conducted within a few minutes. In 1965, 
this rate dropped to 65 percent. 

The main reasons for non-completion of interviews appear in 
Table V. 


4.2 Comparison of Interviewers 


Five interviewers conducted most of the interviews in the 1965 Part 
A tests (one interviewer made 2 of the interviews in the Part B tests and 
no Part A interviews). The Part A interviewers are compared on Tig. 24. 
Generally, the differences among interviewers are small compared with 
the differences among circuits, although in one case the cable ratings 
were lower for the cable than the satellite — the fair or poor ratings 
for interviewer number 4. 


V. COMPARISON OF 1964 AND 1965 TEST RESULTS 


The differences tetween the 1964 and 1965 tests, particularly in echo 
suppressors, make comparisons difficult. However, as discussed below, 


TABLE V— REASONS FOR NOT COMPLETING INTERVIEWS 





No answer 23% 
Customer busy 66% 
Customer refused all interviews 1% 


Language barrier 1% 
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Fig. 24 — Comparison of interviewers. 


those comparisons which seem most reasonable show the results of the 
two tests to be very similar. 

In 1965, the Part A tests used the 2A echo suppressor, which is very 
similar to the B echo suppressor of the 1964 tests, and the interviews 
were in New York City only. The 1964 interviews in New York City 
only using the B echo suppressor are shown on Bar 1 on Fig. 25 while 
the 1965 results are shown on Bar 5. (The 1964 test results have been 
linearly extrapolated to the 545 ms delay of Early Bird. There is no 
extrapolation of the low cable delays.) Comparison of Bars 1 and 5 for 
both cable and satellite delays shows close similarity. 

Since some of the 1965 interviews are on calls to Germany, these have 
been removed in Bar 4 to provide interviews to the United Kingdom 
and I’rance only. The same comparisons can be made. 

In the 1964 tests there was no consistent difference among the echo 
suppressors, and to increase the sample size the New York City inter- 
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views for all suppressors have been combined in Bar 2. There were also 
no significant differences among cities. Thus, Bar 3 represents all inter- 
views in the 1964 tests (at the delays shown). 
The data represented by each bar is summarized below: 
Bar number | represents 1964 interviews in New York only on calls 
to London and Paris using the B echo suppressor. 
Bar number 2 represents 1964 interviews in New York only to 
London and Paris using all echo suppressors. 
Bar number 8 represents 1964 interviews in all cities using all echo 
suppressors. 
Bar number 4 represents 1965 New York interviews on calls to the 
United Kingdom and France only. 
Bar number 5 represents 1965 New York interviews on calls to the 
United Kingdom, France and Germany. 
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The close agreement between all comparisons for comparable amounts 
of delay suggests that the data can be combined as was done on Fig. 3. 


VI. SUMMARY AND CONCLUSIONS 


The following statements summarize the more important results of 
the tests. 

(c) The quality of telephone circuits with echo suppressors decreases 
with increasing transmission delay. 

(ic) Previous satellite calls, for the rates of exposure tested, have no 
effect on the customer’s opinion of his present call. 

(a7) There is no conclusive evidence that the echo suppressors and 
combinations of echo suppressors tested produce significant quality 
differences. It should not be inferred, however, that other echo suppres- 
sors would produce the same results. 

(iv) The customer’s rating of his usual call is relatively independent 
of the quality of his present call. 

(v) Interviewing, as a method of evaluating circuit quality, provides 
consistent results. 

(vi) There is enough variability among interviewers to require an 
experimental design which minimizes interviewer differences. 

The customer opinion of circuit quality for any delay cannot be con- 
sidered static. New advances in echo suppressors are not inconceivable, 
and this may improve the quality. On the other hand, historically tele- 
phone customers have come to expect continuing improvements in 
telephony, and this may tend to lower customer satisfaction. It should 
also be stressed that the customer’s opinion of transatlantic circuits 
with delay does not necessarily reflect his opinion on other routes. Long 
delay circuits to hard-to-reach places may be infinitely better than 
none at all. Conversely, long delay circuits in the domestic network 
may be much less satisfactory than the presently used circuits. 
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